Image Retrieval

---

:::{.column-page}

Model Evaluation COSFIRE Filters Approach

Introduction

We obtain the 26 statistically significant sets of hyperparameters from the classification paper along with their respective training, validation, and test descriptors. Based on these descriptors, we perform image hashing for each set of descriptors using a selected set of MLP hyperparameters (for the grid search).

This is the init_notebook_mode cell from ITables v2.0.1
(you should not see this message - is your notebook trusted?)

The outputs below represent an example of a single experiment based on an array of hyperparameters considered to determine the optimal configuration of the MLP hashing architecture (For bit size 32).

Model structure

class CosfireNet(nn.Module):
    def __init__(self, input_size, bitsize, l1_reg, l2_reg):
        super(CosfireNet, self).__init__()
        self.l1_reg = l1_reg
        self.l2_reg = l2_reg
        self.hd = nn.Sequential(
            nn.Linear(input_size, 300),
            nn.BatchNorm1d(300),
            nn.Tanh(),
            nn.Linear(300, 200),
            nn.BatchNorm1d(200),
            nn.Tanh(),
            nn.Linear(200, bitsize),
            nn.Tanh()
        )
    def forward(self, x):
        regularization_loss = 0.0
        for param in self.hd.parameters():
            regularization_loss += torch.sum(torch.abs(param)) * self.l1_reg  # L1 regularization
            regularization_loss += torch.sum(param ** 2) * self.l2_reg  # L2 regularization
        return self.hd(x), regularization_loss

Density plots

mAP Curves

T-SNE_projection plots

Loss curves

Without regularization

With regularization

Tip

tiply, each row represents a unique combination of MLP hyperparameters, and every column represents the results yielded by each of the 26 statistically significant sets of descriptors.

::: {.panel-tabset}

In these experiments, we have considered four different bit sizes.

Bit size 32

The results in this presentation are from two experimental designs:

::: {.panel-tabset}

Experiment 1 Results

The thresholding is based on fixed values between -1 and 1 on a step size of 0.1.

Validation Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
12	372	32	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	88.15	88.89	87.42	87.97	85.95	88.51	90.37	89.69	88.90	88.50	89.32	88.88	88.44	89.33	88.66	90.90	89.46	89.03	90.45	88.40	89.21	88.56	87.27	88.69	89.24	88.44
13	372	32	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	88.03	87.76	88.11	87.47	87.14	89.78	87.92	89.90	87.77	89.09	88.16	90.41	91.19	88.11	89.11	89.99	88.48	90.26	88.93	88.05	88.70	88.63	88.04	88.34	89.05	88.85
14	372	32	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	87.83	88.50	87.10	87.50	87.98	42.66	88.12	89.24	89.80	87.92	89.40	89.45	89.83	89.27	89.36	88.87	89.00	89.81	88.72	89.33	89.23	89.86	88.66	87.33	89.49	87.92
15	372	32	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	88.31	42.66	87.93	88.42	88.34	87.64	89.14	88.67	89.30	88.40	89.30	90.15	90.59	88.27	89.10	89.92	88.14	89.96	90.09	89.63	87.80	88.68	87.03	87.53	86.88	88.42
32	372	32	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	89.03	90.56	88.60	88.76	88.40	89.81	89.59	88.40	89.03	89.45	89.90	89.40	89.36	89.31	88.59	42.66	89.67	90.52	88.73	89.55	90.34	89.25	89.13	89.00	88.25	88.58
33	372	32	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	87.93	89.94	88.93	87.08	87.36	89.65	89.61	89.81	89.84	89.75	89.52	90.50	89.47	90.16	90.23	89.83	90.34	90.21	88.96	89.67	89.63	89.00	89.29	88.80	89.77	89.06
34	372	32	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	89.51	88.58	89.56	90.16	88.31	88.93	89.65	89.28	42.66	89.09	88.10	91.51	89.41	90.23	89.25	90.25	90.55	90.44	42.66	90.43	89.93	89.88	88.01	87.55	88.77	89.07
35	372	32	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	88.52	88.77	89.29	87.40	89.21	89.10	89.59	89.37	90.86	89.75	88.00	89.51	90.29	91.07	88.89	90.61	90.19	89.40	89.93	90.00	89.83	87.89	90.59	89.29	89.55	88.84
52	372	32	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	88.86	89.77	89.76	89.13	90.25	89.13	89.91	91.26	89.82	88.79	88.79	89.76	89.85	90.46	90.89	90.62	90.09	90.18	89.63	89.76	90.05	89.28	42.66	88.68	90.19	87.86
53	372	32	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	88.95	89.84	88.68	89.23	90.51	89.56	89.87	91.00	89.09	90.49	89.89	91.00	90.46	90.51	91.54	89.86	90.87	90.40	89.80	89.05	88.93	90.39	90.04	89.25	88.99	89.07
54	372	32	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	88.25	88.68	88.18	90.42	90.33	89.27	88.82	90.12	90.20	89.11	89.35	90.47	91.64	90.35	89.76	90.77	90.58	89.55	92.03	90.72	90.25	89.41	87.38	89.60	89.75	88.63
55	372	32	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	88.70	88.71	90.15	89.03	90.26	89.19	90.02	89.35	89.40	90.72	89.36	91.45	89.49	89.50	89.51	91.30	90.58	90.70	88.67	89.75	90.72	88.93	89.98	90.18	88.41	90.97
72	372	32	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	85.63	87.67	87.85	87.26	86.57	88.31	88.52	89.41	89.19	87.78	88.04	88.88	87.44	88.67	88.88	90.18	88.16	89.95	87.82	89.16	88.99	89.30	88.88	87.42	89.39	87.81
73	372	32	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	86.83	88.38	87.84	42.66	88.46	89.87	88.79	89.70	42.66	89.23	89.46	88.71	89.82	88.13	89.61	89.62	89.41	88.85	88.25	88.59	89.02	89.21	87.68	88.73	88.94	87.97
74	372	32	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	87.77	88.68	86.21	88.48	87.43	88.44	89.31	88.79	88.83	88.37	89.89	88.69	89.57	89.28	89.47	90.53	89.63	90.07	89.62	89.34	89.34	88.42	88.83	88.14	88.65	89.36
75	372	32	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	87.23	87.92	88.50	88.56	87.08	88.09	87.81	89.95	89.78	88.73	89.92	89.64	90.49	88.62	89.07	89.25	89.78	89.30	88.37	88.46	89.53	88.70	88.50	88.77	89.33	88.60
92	372	32	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	87.84	88.94	88.33	88.95	87.24	88.90	88.27	91.51	89.81	88.93	89.89	88.98	90.37	90.24	90.65	89.94	90.56	89.08	89.78	89.64	89.56	89.07	88.68	89.32	89.05	88.49
93	372	32	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	87.07	88.51	89.43	89.34	88.59	88.23	88.50	91.40	88.23	89.71	88.70	88.88	89.76	89.40	88.56	90.74	89.41	89.15	89.00	89.83	89.91	89.91	89.80	89.53	89.26	88.59
94	372	32	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	86.82	87.98	88.39	88.70	88.45	87.46	90.57	89.02	89.74	89.09	89.59	89.38	89.62	89.81	89.69	89.68	89.76	89.92	89.42	89.65	88.57	90.00	87.21	89.30	89.26	88.33
95	372	32	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	88.74	90.32	89.71	89.18	88.02	90.25	89.98	90.21	89.73	89.20	89.32	88.98	89.64	90.75	91.04	91.18	88.11	90.58	89.07	89.37	89.13	89.63	89.11	87.92	88.72	88.00
112	372	32	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	88.29	89.21	89.82	88.89	89.66	89.60	89.96	89.74	90.44	90.62	90.80	89.28	90.21	89.80	90.80	90.05	90.41	90.68	88.80	89.40	88.04	89.23	89.43	88.88	89.78	88.89
113	372	32	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	88.65	89.27	90.30	88.22	89.88	90.43	90.14	89.69	89.42	89.25	88.16	90.22	90.75	88.61	89.56	91.24	90.21	90.49	89.51	89.55	89.98	88.09	87.87	88.78	89.08	89.81
114	372	32	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	87.50	89.61	88.71	88.34	89.37	88.81	90.03	89.88	89.42	89.20	89.27	89.75	90.00	88.99	90.07	90.98	90.50	90.00	89.77	89.83	89.82	88.10	90.96	88.33	88.93	89.20
115	372	32	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	87.93	89.47	89.14	87.76	89.45	89.02	90.25	90.04	89.60	89.30	89.34	90.60	91.29	90.47	89.69	89.02	90.20	90.03	89.24	89.67	88.99	89.64	87.85	89.43	89.44	88.45
132	372	32	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	85.72	88.29	87.64	87.75	87.04	88.21	88.04	88.57	88.36	88.52	88.98	89.20	89.79	87.80	87.52	89.75	87.54	88.21	87.15	89.30	88.36	87.14	86.63	86.85	87.49	87.86
133	372	32	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	87.05	88.18	87.50	87.88	42.66	88.31	89.41	89.42	88.73	87.69	91.84	89.61	89.68	89.26	86.90	89.63	88.00	88.87	91.37	87.58	87.89	88.84	42.66	87.64	88.78	87.15
134	372	32	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	88.29	86.22	87.09	86.79	85.72	86.84	89.56	88.01	87.92	87.16	89.23	88.87	88.83	88.26	88.85	89.88	89.71	88.74	90.27	89.14	89.37	88.62	87.54	87.67	88.11	88.42
135	372	32	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	88.26	87.29	88.51	87.39	87.64	88.09	88.38	89.01	87.65	88.83	90.43	88.87	89.34	87.78	89.02	90.55	88.14	89.01	89.28	91.47	88.43	88.07	88.32	88.35	87.41	89.22
152	372	32	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	89.26	87.75	88.84	42.66	88.28	86.64	88.81	89.47	89.17	88.56	89.89	87.75	90.56	89.83	89.51	88.90	90.59	89.46	89.90	90.18	89.29	89.79	88.57	88.83	90.25	88.85
153	372	32	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	88.17	89.40	88.81	89.27	87.40	87.40	89.19	89.02	89.45	89.03	89.41	89.59	89.21	89.13	89.16	89.51	88.95	89.66	89.89	89.45	89.73	88.58	90.70	88.16	87.95	89.23
154	372	32	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	88.35	88.53	88.76	89.97	86.20	89.57	89.24	42.66	89.47	89.59	89.61	89.64	89.08	87.91	89.03	89.80	89.86	90.05	89.66	90.58	89.40	88.47	87.38	88.88	89.56	88.24
155	372	32	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	87.79	88.75	88.74	88.01	87.45	89.50	88.46	88.37	89.41	88.09	89.91	87.42	90.32	89.30	90.43	89.93	90.08	89.68	89.17	90.68	88.82	89.30	89.54	88.46	88.68	88.16
172	372	32	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	89.75	89.47	88.64	87.71	88.37	90.13	90.11	89.82	90.54	90.00	89.27	90.27	90.48	89.28	89.73	91.17	89.94	90.05	90.28	90.50	88.84	89.35	89.06	88.81	89.37	89.35
173	372	32	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	88.87	89.43	89.64	88.35	89.14	88.51	89.05	89.00	89.60	89.26	89.90	89.66	90.95	88.68	90.95	90.15	89.70	87.85	88.33	88.65	88.72	87.93	88.78	88.78	88.16	88.44
174	372	32	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	88.89	88.54	89.65	88.36	88.51	87.85	89.42	90.95	89.71	91.08	90.16	90.52	91.06	91.09	89.10	88.77	89.82	86.53	89.01	89.54	89.34	88.98	89.32	86.90	89.59	89.32
175	372	32	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	88.27	89.76	89.03	88.31	89.08	89.00	89.91	89.51	88.99	90.29	89.60	88.97	88.86	90.00	90.76	89.30	90.06	89.55	89.92	89.30	89.69	88.39	89.83	88.63	90.00	88.35
192	372	32	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	42.66	88.23	86.22	87.00	88.11	89.79	88.80	89.64	42.66	87.66	89.42	88.91	89.90	87.96	89.36	89.99	90.39	89.67	89.22	88.61	88.81	89.12	89.56	89.62	88.12	90.02
193	372	32	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	89.02	89.00	87.31	87.91	88.83	88.22	88.84	91.05	89.20	88.81	88.55	89.73	89.75	88.74	88.62	90.52	87.67	89.32	89.10	90.19	89.21	90.38	87.80	89.53	88.72	89.03
194	372	32	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	87.94	88.16	88.38	87.85	88.13	88.55	89.77	90.04	88.94	89.88	91.24	89.06	91.15	90.03	89.81	89.20	89.52	89.57	88.67	89.48	89.38	89.53	88.31	89.03	89.37	87.65
195	372	32	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	88.48	88.27	87.96	88.86	87.97	88.28	88.51	88.38	89.03	88.95	90.47	90.15	89.06	88.29	89.12	90.38	88.55	90.37	89.30	92.36	89.54	88.85	90.44	88.20	89.79	86.61
212	372	32	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	88.05	89.23	88.12	89.92	88.66	88.64	90.53	90.27	90.24	90.04	89.63	88.69	90.51	89.43	89.98	90.21	90.45	90.39	90.31	89.79	88.68	88.61	89.33	88.62	87.43	88.26
213	372	32	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	88.74	89.79	87.43	88.29	87.92	88.14	89.09	91.35	89.80	89.37	89.58	89.65	89.49	88.98	90.59	91.18	90.15	90.34	91.23	89.38	89.14	89.31	88.71	89.91	89.13	87.80
214	372	32	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	86.91	89.32	88.93	88.92	88.63	87.82	88.58	89.73	89.06	90.29	88.90	88.58	90.09	89.15	90.30	90.38	89.92	90.25	89.91	90.94	88.11	89.03	88.99	88.23	88.62	88.21
215	372	32	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	87.70	88.98	90.32	87.97	89.08	88.59	90.31	89.03	89.67	89.29	89.20	88.59	90.37	88.84	90.97	89.58	89.40	90.39	88.70	89.47	89.83	88.10	88.97	89.67	89.53	89.94
232	372	32	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	89.31	89.19	89.78	89.51	88.58	89.13	90.58	89.55	89.00	42.66	89.40	89.73	89.27	90.71	90.58	90.84	89.32	89.69	90.68	89.15	88.80	88.61	88.04	89.15	89.29	90.16
233	372	32	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	88.93	89.56	90.73	89.62	90.52	88.36	89.43	90.00	89.61	90.14	89.16	90.18	90.80	89.66	89.95	91.28	90.59	90.37	90.18	91.19	88.83	89.27	89.04	88.97	89.41	88.16
234	372	32	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	88.90	89.70	89.37	89.87	89.49	88.81	90.29	91.11	90.32	89.82	90.04	91.38	90.57	90.65	89.65	90.62	90.40	90.68	90.38	89.84	90.49	89.43	88.52	89.60	89.99	88.52
235	372	32	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	89.14	88.82	90.62	90.11	88.88	89.23	89.94	90.80	88.92	90.66	89.60	90.33	91.37	90.42	90.51	91.35	90.07	89.85	89.89	90.56	89.82	89.62	86.46	89.06	89.52	88.13
252	372	32	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	88.17	87.28	87.69	87.73	87.55	88.70	89.37	88.50	88.40	88.32	88.23	89.09	90.62	89.93	87.99	89.46	89.85	88.75	89.08	88.95	89.13	88.51	89.19	87.41	89.66	88.95
253	372	32	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	88.17	88.86	87.03	88.12	87.99	88.78	89.58	90.62	91.09	89.40	88.59	89.77	90.73	88.44	88.92	90.76	89.26	89.33	90.01	89.73	89.09	88.07	89.69	88.89	89.64	89.32
254	372	32	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	86.47	88.43	87.82	89.52	86.62	89.30	90.08	87.79	89.05	88.75	89.45	88.57	89.85	89.27	87.72	88.61	89.20	89.10	88.81	89.19	87.62	88.34	88.99	88.85	89.13	88.97
255	372	32	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	85.98	88.14	89.86	88.36	87.05	90.41	89.45	90.06	90.20	89.11	88.35	88.30	90.54	88.39	89.04	90.13	88.30	89.69	88.52	90.21	87.98	89.29	88.92	89.61	87.56	88.26
272	372	32	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	89.19	89.91	87.92	88.53	87.45	89.19	89.39	90.83	89.98	89.87	89.67	89.82	90.33	89.80	89.79	91.55	90.17	90.86	91.05	88.96	90.10	88.91	88.09	88.11	89.67	89.52
273	372	32	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	89.14	88.95	91.18	88.17	88.58	90.08	88.53	89.77	90.04	90.42	90.61	88.34	90.26	90.34	89.36	89.15	88.56	90.74	90.50	90.80	89.48	89.84	89.84	88.44	89.36	88.05
274	372	32	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	87.73	89.60	90.26	89.20	88.83	88.64	88.50	89.76	89.94	89.62	89.70	89.89	89.26	90.56	89.99	90.65	89.23	90.03	89.17	88.60	89.58	89.63	89.88	87.58	89.50	88.30
275	372	32	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	88.34	89.79	89.19	89.96	87.92	88.46	90.69	89.12	89.18	91.24	89.26	90.33	89.75	90.01	89.73	90.39	89.44	90.73	90.89	89.30	90.07	88.67	89.32	88.49	89.97	88.61
292	372	32	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	88.77	89.76	89.57	89.05	89.92	89.10	88.74	90.42	91.13	89.79	89.17	89.97	90.66	91.06	89.20	90.74	90.04	91.15	89.85	89.66	90.66	90.35	88.68	87.83	90.29	88.69
293	372	32	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	88.67	88.28	89.05	88.63	89.39	89.48	90.42	89.86	89.86	89.49	89.84	89.22	90.31	88.51	90.85	89.07	90.52	90.48	89.13	89.59	90.50	88.92	89.90	88.25	88.95	88.58
294	372	32	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	88.94	88.32	90.31	89.44	88.91	88.63	89.14	89.97	90.35	90.29	88.97	89.60	90.14	90.91	89.34	90.35	89.01	90.26	89.06	89.95	89.45	89.20	89.26	89.03	89.31	87.31
295	372	32	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	89.34	88.98	88.96	88.69	89.01	88.65	91.30	91.00	90.08	90.66	90.78	89.51	90.96	90.71	89.69	90.36	90.27	88.77	88.99	90.04	89.51	89.58	90.18	88.93	90.32	89.01
312	372	32	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	86.99	86.86	87.15	86.28	87.23	87.57	87.76	89.32	87.95	88.06	88.64	88.55	89.36	88.17	87.62	89.63	87.99	88.87	89.18	87.45	88.68	89.76	85.67	88.58	88.99	86.22
313	372	32	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	87.55	88.88	87.03	87.68	86.17	90.24	89.18	87.55	88.22	87.98	89.19	88.66	88.48	87.66	89.23	90.30	88.66	89.04	90.01	89.45	88.72	88.79	88.90	85.97	88.66	88.47
314	372	32	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	87.18	87.46	86.88	88.07	85.70	87.96	89.21	88.80	86.24	87.21	89.61	88.96	90.32	88.02	88.04	89.80	88.71	88.98	88.28	88.78	88.05	88.39	88.43	87.52	89.45	87.19
315	372	32	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	88.30	87.85	87.50	86.12	85.63	88.55	87.12	88.92	88.80	87.75	89.51	90.04	89.23	89.36	87.69	88.26	88.74	87.55	88.61	89.03	88.73	87.98	88.29	88.59	89.00	88.31
332	372	32	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	88.44	87.99	88.91	88.63	87.72	88.83	89.42	89.02	87.89	90.07	89.79	89.40	89.77	90.08	89.68	89.82	89.14	90.77	89.43	92.40	89.17	88.98	89.09	87.92	88.91	88.89
333	372	32	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	88.80	88.35	89.15	89.48	87.61	89.65	90.38	89.42	90.62	88.90	89.93	90.12	90.16	89.86	89.73	89.88	89.54	90.66	90.58	90.66	88.55	89.99	88.44	88.61	89.66	89.10
334	372	32	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	89.01	89.44	88.87	88.20	87.82	88.57	89.10	90.51	88.71	89.69	89.17	90.64	91.09	89.59	88.99	89.57	89.90	90.62	89.62	89.79	88.59	88.88	88.74	88.46	88.10	88.04
335	372	32	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	88.04	89.41	88.35	87.78	88.87	90.08	89.13	90.59	89.35	89.33	89.23	87.91	90.20	90.10	89.75	91.28	89.57	89.53	90.01	89.32	86.89	89.21	88.25	88.29	88.45	88.02
352	372	32	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	89.55	89.59	88.43	88.83	87.71	42.66	90.01	89.24	89.23	89.49	90.15	90.22	89.89	89.34	89.05	89.53	89.97	89.88	89.37	91.08	88.34	89.07	87.82	87.71	88.66	89.24
353	372	32	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	88.48	89.12	88.65	89.04	89.85	89.08	87.90	89.83	88.45	89.91	89.52	89.93	90.37	90.31	89.80	88.39	90.83	88.86	89.51	89.47	89.48	89.05	88.23	88.98	89.15	89.38
354	372	32	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	89.10	88.17	89.38	88.41	88.92	91.51	89.01	89.94	89.96	90.06	89.89	90.07	89.60	89.41	90.07	91.41	90.96	90.67	89.47	90.70	88.36	88.26	88.64	88.91	90.61	89.21
355	372	32	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	88.97	88.52	90.15	88.83	89.83	88.54	89.78	89.94	89.78	90.28	89.76	89.50	90.32	89.99	89.37	89.88	90.83	90.52	88.60	90.96	89.49	89.37	88.91	86.97	89.48	88.98
372	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	90.09	92.57	90.60	91.64	91.29	90.49	91.30	90.30	92.56	91.06	90.66	90.80	92.14	91.15	89.49	91.71	90.67	92.03	91.53	92.01	90.64	89.94	90.74	89.47	91.11	90.27
373	372	32	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	90.39	91.40	89.71	90.50	91.31	90.05	90.14	89.57	90.35	90.69	89.83	90.87	91.00	92.07	90.10	91.45	90.70	90.47	91.04	90.43	91.00	89.95	90.45	89.77	90.36	89.59
374	372	32	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	91.27	92.17	90.31	92.62	89.75	89.68	90.66	91.08	91.80	89.98	91.15	91.00	90.69	90.49	90.18	91.35	90.86	90.95	91.19	90.84	90.26	88.86	89.80	89.95	88.92	88.79
375	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.01	90.30	91.57	92.49	91.07	90.89	91.06	89.36	90.73	90.41	90.62	90.39	91.64	91.49	91.10	92.92	91.95	92.75	91.54	92.25	92.30	90.12	89.62	90.15	90.04	89.40
392	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	90.38	90.96	90.03	91.43	91.05	91.00	90.18	90.27	91.32	89.70	91.44	90.33	91.55	90.03	90.56	91.28	91.02	91.45	91.81	92.14	90.47	89.75	90.37	89.20	90.39	90.03
393	372	32	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	90.40	90.25	89.79	91.19	91.16	91.14	90.06	90.45	90.08	89.57	91.41	90.35	91.89	91.09	89.16	91.37	91.17	92.56	91.52	91.11	90.27	89.28	90.36	89.24	90.52	90.93
394	372	32	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	88.37	89.97	90.17	91.46	90.83	90.73	90.88	90.54	91.95	89.83	90.78	91.05	91.00	89.84	91.74	90.48	90.24	91.72	91.26	90.13	90.21	89.15	90.04	88.93	89.70	90.28
395	372	32	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	88.70	90.12	90.67	91.82	90.13	89.81	90.03	91.20	90.24	90.05	90.86	90.66	90.56	90.64	91.42	89.44	91.12	91.66	90.54	91.24	89.56	90.36	89.79	89.44	90.26	88.85
412	372	32	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	90.71	89.48	89.67	89.53	90.14	90.10	90.38	91.09	89.35	90.57	91.64	91.13	91.02	89.81	90.59	92.36	91.18	90.70	90.66	91.46	90.99	90.18	90.45	89.87	90.73	89.63
413	372	32	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	89.36	90.63	91.30	91.70	90.86	91.23	90.50	90.58	90.56	90.53	91.08	89.82	91.56	90.29	90.73	90.57	90.72	92.00	90.87	90.46	89.80	91.15	88.26	90.95	90.61	90.65
414	372	32	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	89.07	92.03	90.27	90.08	89.75	91.39	89.33	90.97	90.84	89.21	90.76	91.52	91.49	91.63	90.66	91.43	90.41	91.73	90.82	90.11	88.67	89.27	90.12	90.56	90.83	89.49
415	372	32	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	90.38	90.65	90.24	90.92	90.33	91.78	90.33	91.53	90.52	89.73	91.25	90.89	91.86	90.42	90.74	91.10	90.26	91.15	90.46	90.14	90.39	90.88	90.37	88.58	89.97	89.90
432	372	32	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	91.76	90.55	90.50	91.21	91.98	90.20	90.65	90.05	90.64	91.58	90.25	91.40	90.31	89.41	91.47	90.95	91.65	90.80	90.87	91.53	90.14	88.47	89.25	88.87	89.94	89.36
433	372	32	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	90.98	90.08	90.64	91.13	90.43	89.81	89.94	90.76	90.73	91.40	89.08	90.11	89.99	91.01	89.73	91.82	90.46	91.65	90.20	90.82	90.15	89.12	91.04	90.18	89.97	89.49
434	372	32	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	89.31	91.43	89.70	91.95	91.17	90.62	90.73	91.32	90.38	91.34	90.56	90.48	91.94	89.94	90.71	91.00	90.91	90.80	91.21	92.02	90.70	90.49	88.38	90.05	88.65	88.90
435	372	32	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	90.70	91.29	89.30	91.33	91.27	89.76	91.18	91.10	92.46	90.43	90.23	89.71	90.89	90.58	91.45	90.94	90.96	90.64	90.30	90.58	89.79	89.51	88.79	90.47	90.68	89.01
452	372	32	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	90.14	89.74	90.70	90.55	90.78	89.81	91.54	90.89	90.51	90.72	90.54	91.46	90.80	91.12	89.13	92.04	89.64	89.97	91.28	90.45	88.83	90.11	89.55	89.27	88.96	89.27
453	372	32	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	89.57	91.15	89.66	91.18	91.36	90.68	90.12	91.20	89.49	89.85	89.58	91.51	91.00	90.86	89.06	91.27	91.50	90.79	90.24	91.82	91.05	89.05	88.82	88.02	89.86	90.77
454	372	32	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	89.02	89.42	90.41	90.00	90.00	89.77	90.70	90.17	90.68	89.44	89.98	89.90	90.31	90.35	89.29	90.80	90.98	90.42	91.93	89.73	88.72	89.59	89.04	88.90	90.58	89.03
455	372	32	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	89.59	90.29	89.98	89.36	92.46	90.00	89.83	90.39	89.91	91.00	90.32	90.38	91.61	89.60	90.99	90.64	90.01	91.06	90.20	91.27	90.57	89.88	88.97	89.35	90.17	89.66
472	372	32	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	89.20	89.49	90.32	90.60	89.78	91.60	89.39	90.30	90.82	90.17	91.17	90.86	91.50	90.03	90.21	92.56	88.74	90.86	90.15	90.01	89.51	89.58	88.76	88.75	92.42	89.79
473	372	32	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	89.43	90.63	89.84	90.11	90.45	90.51	89.63	89.96	89.77	89.68	90.56	90.66	89.72	89.46	90.26	90.48	89.21	91.34	90.06	90.39	89.36	89.74	87.44	88.79	89.50	89.94
474	372	32	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	90.39	89.81	89.69	90.50	89.74	88.79	89.51	90.96	91.11	90.15	90.18	90.45	90.52	88.24	89.01	89.54	90.10	90.78	89.13	89.81	89.10	90.06	87.17	88.11	89.46	88.54
475	372	32	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	89.65	91.05	89.81	89.76	90.22	90.28	90.35	91.66	90.90	90.61	90.22	90.71	89.45	90.21	90.92	90.38	91.23	89.89	89.69	90.61	89.99	90.41	90.36	88.78	91.26	89.21
492	372	32	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	90.52	91.80	91.70	89.46	90.49	90.49	90.74	89.74	90.20	90.79	90.76	90.49	90.42	89.94	91.42	90.65	89.61	90.31	91.70	90.52	89.16	89.88	88.75	89.56	90.52	88.49
493	372	32	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	90.85	91.30	91.32	92.51	91.26	91.22	91.45	90.01	90.91	89.67	90.45	90.62	92.06	91.58	89.41	90.97	90.43	90.51	91.21	90.39	89.07	89.44	89.74	88.87	90.07	90.33
494	372	32	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	90.55	90.98	90.41	91.30	90.99	90.62	89.85	90.42	90.36	91.97	89.71	91.39	90.98	89.58	89.46	92.11	91.49	91.36	91.02	91.98	89.53	88.64	89.05	87.87	89.20	90.32
495	372	32	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	89.85	90.58	90.91	90.70	91.87	89.89	90.43	89.22	91.20	90.06	90.98	91.33	91.52	91.05	90.70	91.05	91.04	91.30	90.99	90.37	88.94	89.01	90.45	89.33	90.15	88.09
512	372	32	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	89.52	91.19	90.48	91.11	90.46	92.45	90.88	90.74	89.70	90.20	89.69	90.91	90.27	89.95	89.05	90.73	91.08	90.81	90.82	90.73	89.66	89.65	90.69	89.05	89.79	88.83
513	372	32	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	90.72	92.16	91.46	90.83	90.97	90.25	88.73	90.63	90.07	90.50	90.29	90.68	89.79	89.47	89.54	90.12	89.41	90.75	91.47	90.76	88.81	89.55	89.23	89.36	89.68	88.47
514	372	32	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	89.89	90.00	90.44	90.79	90.31	89.76	90.36	89.52	90.16	90.86	89.62	91.43	91.43	90.51	90.12	90.68	90.25	90.72	91.95	90.91	89.57	89.90	89.18	90.44	90.10	89.56
515	372	32	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	89.96	91.00	90.21	91.69	91.58	90.09	90.46	90.48	90.03	89.97	90.64	90.36	90.25	91.05	90.67	90.69	90.41	91.11	92.01	89.74	90.46	90.09	88.82	87.77	89.55	89.92
532	372	32	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	88.21	89.64	91.06	91.35	91.51	90.65	90.89	90.57	90.91	90.61	90.65	90.56	90.21	89.21	90.44	90.37	91.46	90.20	90.67	90.02	89.08	89.66	89.39	89.31	90.64	89.52
533	372	32	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	89.99	89.50	90.53	90.01	90.54	90.27	90.15	90.90	89.11	90.27	89.95	90.33	89.46	89.35	90.06	89.46	89.39	90.40	89.73	89.84	89.16	90.01	87.62	89.43	88.55	88.95
534	372	32	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	89.42	90.67	90.24	89.91	89.64	89.89	90.24	91.32	90.63	89.77	90.70	90.55	89.09	89.87	76.18	91.37	89.31	90.31	89.93	90.62	88.62	89.13	86.63	89.57	89.28	89.08
535	372	32	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	88.57	91.21	89.19	89.55	89.77	89.39	90.40	90.89	90.47	90.36	89.91	90.38	88.40	90.31	90.86	89.66	90.38	90.24	89.71	90.57	89.87	89.04	87.67	89.09	90.01	89.36
552	372	32	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	89.81	90.14	89.91	91.41	90.99	89.79	90.33	90.37	90.04	90.40	90.21	91.14	92.21	91.86	90.54	90.76	90.97	91.77	91.24	91.28	90.48	91.27	90.13	88.85	90.33	89.98
553	372	32	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	90.05	91.47	90.51	91.96	90.96	89.86	89.89	90.34	91.10	90.66	89.96	90.47	90.79	91.37	91.20	90.45	91.29	91.13	91.06	89.83	89.54	89.54	90.36	89.15	90.66	89.29
554	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	91.75	90.64	91.36	91.45	91.75	91.20	91.25	90.17	90.98	89.98	90.54	91.38	91.75	90.31	91.51	89.48	91.03	91.22	91.14	91.56	90.64	89.42	88.73	89.92	90.82	89.40
555	372	32	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	90.47	92.06	90.43	92.08	91.07	90.59	90.74	90.69	90.34	91.41	90.55	90.88	91.20	90.12	90.13	91.73	91.06	90.77	90.66	90.81	89.77	89.75	89.27	90.10	89.56	89.74
572	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	91.02	89.65	90.94	92.48	90.98	91.04	89.92	91.06	90.44	90.19	90.91	90.66	92.68	90.84	90.02	91.31	90.20	90.52	91.25	91.03	90.49	90.69	90.09	89.53	91.09	89.77
573	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	89.20	91.69	91.45	90.34	90.87	91.99	91.95	90.83	91.10	90.28	90.25	92.00	91.23	91.03	91.37	91.72	92.25	91.86	91.65	90.60	89.70	89.53	90.03	90.51	90.88	88.93
574	372	32	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	89.12	91.10	89.71	91.75	91.33	91.55	91.04	90.57	89.99	90.98	90.59	90.33	90.75	90.77	91.70	90.31	91.20	90.19	90.88	91.32	91.23	88.93	89.28	90.63	89.71	90.18
575	372	32	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	90.61	90.70	90.78	90.54	91.25	90.50	90.41	90.94	90.37	90.47	90.36	90.94	92.04	90.93	90.07	91.43	90.59	91.03	90.80	90.53	90.54	90.22	90.04	89.79	90.43	89.40
592	372	32	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	90.67	90.97	89.92	91.37	90.59	91.12	90.20	90.67	89.99	90.19	90.89	91.01	91.00	90.27	90.88	91.00	90.23	90.94	90.18	90.38	88.10	89.59	89.68	90.21	90.73	89.87
593	372	32	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	91.04	90.60	90.39	90.83	91.59	90.64	90.74	90.68	90.65	89.23	90.87	90.72	92.37	90.85	90.61	89.94	89.82	90.18	90.72	90.62	89.45	90.11	89.87	88.74	91.24	89.54
594	372	32	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	90.76	91.29	90.05	91.79	90.26	91.42	91.28	90.06	90.10	88.22	89.75	89.88	90.54	91.26	90.42	90.66	91.40	90.25	91.09	90.34	91.74	90.30	90.44	89.60	90.04	90.87
595	372	32	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	89.85	90.93	89.95	90.25	90.23	89.11	90.46	90.59	90.31	89.45	91.56	90.93	91.05	90.68	90.31	90.82	91.05	91.22	91.12	91.85	90.50	90.44	87.81	90.52	90.23	90.49
612	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	90.00	91.92	89.37	91.29	91.53	91.64	92.37	90.38	90.44	90.78	90.84	91.29	91.31	89.98	92.36	90.55	90.54	90.77	90.28	90.69	90.33	89.57	91.47	89.48	90.19	88.67
613	372	32	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	90.15	91.66	89.89	89.76	91.65	90.95	91.20	90.71	90.90	91.27	90.48	90.58	91.45	90.41	89.57	91.52	90.93	91.44	91.11	90.85	88.75	88.48	89.75	89.59	89.61	89.97
614	372	32	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	88.97	91.23	88.98	91.09	89.85	90.33	91.34	90.63	90.11	90.74	89.85	90.53	90.71	89.61	89.52	90.78	90.38	91.61	90.26	90.64	89.05	89.76	89.99	87.96	89.79	89.89
615	372	32	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	91.27	91.67	89.84	91.93	90.89	91.22	91.32	89.71	89.82	90.71	90.24	90.60	91.15	90.90	89.38	91.15	90.03	91.54	90.57	91.85	89.52	89.23	91.02	88.81	89.03	88.26
632	372	32	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	90.51	89.77	90.58	91.17	90.65	90.39	90.63	91.01	90.19	90.77	90.78	90.37	91.03	91.08	91.05	91.49	91.44	90.87	90.57	91.35	88.42	90.55	89.23	88.81	90.66	90.59
633	372	32	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	90.03	90.80	90.15	91.45	90.84	90.02	90.88	90.34	90.24	91.46	90.04	90.46	91.42	89.39	89.85	90.16	91.44	90.88	91.10	91.15	89.64	87.91	89.93	88.85	88.38	90.59
634	372	32	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	89.43	90.71	90.88	91.52	90.67	89.91	90.39	89.63	90.52	90.09	90.95	91.19	90.43	90.28	89.64	90.88	90.50	90.68	89.97	90.38	89.44	89.66	90.81	88.12	88.96	89.39
635	372	32	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	91.72	90.05	89.04	91.42	91.85	90.96	90.56	90.13	90.63	90.12	90.82	91.50	91.61	90.11	90.23	90.75	91.24	90.34	90.52	92.68	89.01	89.66	89.55	90.40	91.30	89.92
652	372	32	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	89.70	90.67	90.11	90.67	90.07	89.84	90.10	90.86	91.46	90.20	90.79	90.19	89.87	89.88	90.05	90.50	89.86	90.28	90.30	91.07	89.92	89.82	90.47	89.67	89.42	88.46
653	372	32	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	90.49	90.63	90.11	91.06	90.66	90.57	91.11	89.97	89.59	90.84	89.60	90.62	90.79	90.35	90.06	91.29	90.50	90.91	89.46	89.72	89.61	89.18	88.42	89.61	89.13	89.44
654	372	32	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	90.12	89.94	90.60	89.80	91.64	90.03	89.98	90.91	90.89	90.11	90.49	89.86	91.32	90.26	89.09	91.19	90.51	91.35	90.16	89.33	90.68	91.62	87.85	89.12	89.30	90.93
655	372	32	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	89.94	90.32	90.09	89.93	89.87	89.52	90.51	91.23	90.28	89.39	90.85	90.00	90.12	90.02	89.60	90.77	91.58	90.48	90.63	89.97	89.45	90.51	88.32	89.14	89.22	89.49
672	372	32	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	91.18	91.69	90.98	91.08	91.33	90.45	91.31	89.77	90.21	90.69	90.24	91.00	92.15	91.98	90.29	91.35	91.15	90.89	90.51	90.45	88.84	88.51	88.93	88.69	90.98	90.42
673	372	32	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	91.02	91.40	90.59	90.30	90.20	89.43	91.16	89.94	91.67	90.74	90.71	90.13	90.16	90.64	90.79	89.81	91.85	91.19	91.08	90.34	89.27	90.37	90.08	89.17	89.19	88.53
674	372	32	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	89.74	91.50	90.54	91.23	89.69	89.37	90.96	91.50	90.67	91.50	91.44	90.14	90.21	91.73	89.97	92.24	91.11	91.19	90.05	90.22	87.82	89.55	89.02	88.63	89.24	90.05
675	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	91.33	92.57	90.36	89.78	91.66	90.59	90.68	90.10	90.62	90.86	90.72	90.25	91.34	90.86	88.92	91.57	90.79	91.19	90.60	92.60	89.45	89.23	91.11	89.35	90.39	89.73

Test Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
12	372	32	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	94.34	94.72	94.24	94.62	93.58	94.74	95.85	95.94	93.45	94.49	94.81	93.43	95.31	95.42	94.39	94.81	94.85	94.63	94.03	94.40	95.13	94.66	93.97	93.90	94.43	94.14
13	372	32	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	93.86	93.16	93.72	94.48	93.79	94.33	93.60	94.68	93.92	93.07	93.81	94.31	94.85	94.57	93.48	94.55	94.43	93.83	94.12	94.41	94.29	94.46	94.28	94.57	94.63	93.67
14	372	32	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	94.02	94.75	93.70	93.73	94.48	49.17	93.25	94.34	94.56	94.47	95.52	93.95	94.68	93.63	94.07	94.90	94.98	95.53	94.46	93.23	95.58	95.38	94.36	94.86	94.44	94.63
15	372	32	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	94.41	49.17	94.27	93.75	93.52	92.71	93.72	93.19	93.34	95.08	94.24	94.84	94.58	93.67	94.35	94.01	93.77	94.56	93.18	92.46	94.83	94.20	93.83	93.37	94.52	93.84
32	372	32	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	94.86	94.95	94.69	93.82	94.05	93.22	94.32	94.08	94.01	94.92	95.28	94.76	94.54	95.24	94.34	49.17	95.45	95.30	94.94	94.56	95.28	94.77	94.75	94.28	94.20	93.99
33	372	32	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	94.46	95.28	94.31	93.21	93.64	92.92	94.70	95.00	94.80	95.20	95.00	93.43	93.78	95.12	95.04	95.41	94.87	94.30	94.71	93.75	95.12	94.78	94.37	94.68	94.96	95.15
34	372	32	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	95.27	93.01	95.39	94.95	94.62	94.31	94.43	93.43	49.17	95.61	93.29	93.96	94.54	95.60	93.83	95.27	94.76	94.89	49.17	94.30	95.44	95.51	93.05	94.19	94.35	94.67
35	372	32	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	95.68	94.86	95.11	94.07	95.27	93.81	95.72	94.62	95.26	94.44	94.92	94.44	94.57	95.09	93.66	95.22	95.29	94.11	94.71	95.29	94.54	94.61	95.56	95.32	95.28	94.98
52	372	32	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	95.29	94.46	96.06	93.11	94.77	94.56	94.10	93.96	94.60	95.15	94.71	93.64	94.95	95.52	94.82	94.92	94.90	94.19	94.79	94.15	95.64	95.11	49.17	94.67	93.48	94.17
53	372	32	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	95.83	95.09	94.04	94.52	95.42	94.47	95.58	94.54	95.33	94.03	94.62	94.99	95.60	94.65	94.28	94.12	94.68	95.03	93.62	94.76	94.07	95.69	94.85	94.37	93.73	95.58
54	372	32	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	95.30	93.67	94.98	93.67	94.62	93.60	93.77	94.43	94.86	94.38	94.55	94.99	94.70	95.06	93.81	94.82	95.48	93.63	95.01	94.46	95.03	94.80	93.37	94.56	94.89	93.21
55	372	32	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	94.01	94.71	93.88	94.33	95.39	92.44	95.04	93.82	94.83	94.66	93.56	94.58	94.56	93.87	94.12	94.63	95.07	94.83	93.16	94.89	95.35	94.53	95.38	95.38	94.30	94.29
72	372	32	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	93.38	94.11	93.15	93.25	94.41	93.63	94.51	95.55	94.77	95.49	93.66	93.59	94.47	93.55	94.60	95.61	95.39	94.73	93.29	94.54	94.89	95.42	95.13	93.46	95.51	94.65
73	372	32	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	94.14	94.55	94.27	49.17	94.27	93.82	94.22	93.74	49.17	93.86	94.42	94.36	94.85	93.96	93.87	94.83	94.78	94.06	93.75	94.06	94.64	93.77	95.68	93.69	95.05	94.26
74	372	32	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	93.97	93.77	92.70	92.98	92.72	92.77	92.31	93.29	93.10	93.83	93.75	93.19	95.06	94.10	94.17	93.83	93.76	94.12	93.56	94.64	94.41	93.11	94.81	94.06	94.47	93.61
75	372	32	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	93.37	93.29	94.33	94.42	93.78	93.09	93.20	94.81	93.92	93.36	94.23	93.78	94.33	93.67	95.04	95.33	95.27	93.54	92.99	94.63	95.02	94.25	95.78	94.86	95.21	94.91
92	372	32	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	93.71	94.03	94.69	93.79	93.72	94.30	93.57	94.14	93.09	94.19	95.41	94.24	94.83	94.00	93.89	93.63	95.35	94.76	93.91	94.21	94.40	94.34	94.60	95.07	96.02	92.98
93	372	32	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	94.03	93.66	94.46	93.72	94.75	94.18	93.88	94.82	92.80	93.60	93.53	93.33	94.60	93.96	93.10	93.84	95.23	92.44	93.68	94.46	95.17	95.36	95.29	94.05	94.97	94.33
94	372	32	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	94.46	95.10	94.38	94.72	93.43	93.52	94.38	94.18	94.33	95.07	93.79	94.54	94.33	93.13	94.59	93.31	94.51	95.38	94.21	93.97	94.54	95.46	96.17	95.12	94.67	94.63
95	372	32	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	94.07	94.80	95.23	93.80	94.31	94.49	93.73	94.10	94.74	94.47	94.69	94.36	93.41	93.44	94.26	95.28	93.14	93.83	94.70	94.53	94.85	95.29	94.52	93.31	94.59	94.55
112	372	32	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	93.83	94.71	94.99	94.00	93.39	93.50	94.49	93.84	95.29	94.10	93.97	94.70	94.83	94.73	94.29	94.29	93.59	94.11	95.00	94.39	94.36	95.56	95.96	93.61	95.04	93.66
113	372	32	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	94.52	94.37	94.99	93.78	93.27	94.97	94.88	94.33	94.12	93.21	95.42	93.34	94.61	94.46	93.82	94.26	95.18	94.37	94.40	94.49	94.64	94.96	94.34	94.52	95.08	94.56
114	372	32	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	93.19	94.09	93.83	94.77	94.96	95.05	94.44	93.12	94.92	93.95	95.08	93.23	92.54	93.13	93.27	94.06	95.07	94.26	93.76	94.13	96.34	93.42	94.97	92.90	95.17	93.59
115	372	32	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	94.07	94.83	93.38	93.39	94.18	94.51	93.38	94.54	94.14	93.80	94.03	94.74	94.43	93.94	93.55	94.73	94.45	93.21	95.27	94.32	94.65	95.28	94.47	95.17	95.58	93.91
132	372	32	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	92.97	94.20	94.09	93.90	93.49	93.28	93.89	93.16	93.35	94.04	92.83	93.87	94.19	93.22	93.92	94.54	92.99	92.06	92.27	94.24	95.09	94.16	94.03	94.22	93.98	94.11
133	372	32	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	94.30	93.58	93.24	93.83	49.17	92.57	93.91	93.74	94.13	92.24	92.82	92.97	94.10	95.07	92.24	92.70	94.59	94.14	94.64	94.27	93.72	95.17	49.17	93.50	94.63	94.65
134	372	32	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	94.40	91.44	94.28	92.56	92.88	91.74	95.34	94.41	94.55	94.48	95.29	93.46	92.59	95.17	93.77	94.28	94.13	93.92	94.98	94.58	95.23	94.85	94.72	94.11	94.81	94.74
135	372	32	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	93.77	93.29	94.45	91.92	93.39	92.44	93.84	92.25	91.51	95.02	93.64	93.46	94.60	95.24	94.62	94.58	93.73	93.12	93.54	92.11	94.13	94.55	95.90	93.14	93.80	94.41
152	372	32	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	95.94	94.75	94.25	49.17	94.82	90.44	92.71	93.59	92.63	94.33	94.29	92.21	94.07	94.88	95.49	93.59	95.36	94.34	93.54	93.82	94.98	95.06	95.79	94.55	96.50	94.81
153	372	32	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	93.79	95.05	94.63	94.85	93.62	89.97	93.95	92.43	92.23	93.68	92.93	93.13	94.17	94.31	94.38	92.92	93.75	94.83	94.31	92.33	94.04	94.39	94.95	94.48	95.71	94.17
154	372	32	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	94.31	94.05	94.38	93.21	93.78	92.97	93.90	49.17	93.49	94.90	93.56	92.83	94.77	94.78	92.78	93.58	94.96	92.26	94.37	93.58	95.02	95.10	94.57	95.62	95.20	94.00
155	372	32	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	94.60	94.90	95.15	93.23	94.72	94.12	94.52	93.62	94.33	93.18	93.60	93.63	95.63	95.27	93.62	93.45	92.47	94.73	93.88	93.88	94.67	95.12	94.68	94.81	94.61	93.60
172	372	32	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	94.37	94.39	95.86	92.95	94.12	94.36	94.40	94.48	93.82	93.37	92.61	91.28	93.32	93.56	92.62	95.42	91.96	92.48	93.68	93.71	94.79	94.45	94.10	95.30	94.43	94.62
173	372	32	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	94.95	93.86	95.27	92.82	93.41	93.45	92.32	93.95	93.61	92.09	92.39	92.11	93.23	93.80	94.52	94.58	94.08	91.35	91.54	93.15	94.44	94.20	93.90	94.79	94.05	94.15
174	372	32	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	93.91	93.07	94.31	92.99	93.01	92.61	94.64	92.97	91.74	94.81	93.54	92.36	95.13	93.35	92.30	92.08	94.22	92.01	93.55	94.10	95.95	94.62	94.30	94.64	95.37	94.30
175	372	32	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	90.58	93.44	94.22	92.64	95.07	95.39	93.48	94.88	91.68	94.19	93.29	91.55	92.93	93.66	93.23	92.67	94.73	92.80	93.05	94.46	95.05	94.39	94.48	94.70	93.75	94.29
192	372	32	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	49.17	94.92	93.79	92.81	94.91	94.67	94.21	95.51	49.17	93.92	95.47	94.66	94.29	94.75	94.21	95.68	94.70	95.83	95.37	95.16	94.30	94.63	95.07	94.87	93.92	94.84
193	372	32	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	95.01	94.97	92.55	94.80	94.67	93.24	94.51	94.34	94.33	93.90	94.01	95.17	94.00	94.87	93.07	95.39	93.37	94.07	94.76	95.14	95.14	95.63	94.27	94.96	94.62	94.79
194	372	32	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	94.81	94.53	94.48	94.53	94.69	94.15	94.30	95.27	94.99	94.79	94.76	95.31	95.64	94.14	93.74	93.47	94.62	93.60	95.05	94.93	95.40	94.65	94.36	94.75	95.02	93.95
195	372	32	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	94.73	93.60	95.08	94.59	93.60	94.32	94.00	93.43	94.17	95.07	94.78	94.58	95.38	95.11	94.49	94.18	95.10	94.92	93.49	95.04	94.53	95.57	94.78	94.62	95.14	93.78
212	372	32	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	93.63	94.07	94.28	94.41	94.18	93.78	94.81	95.08	94.17	94.58	94.49	93.93	93.84	94.40	94.35	95.07	95.61	94.51	94.31	93.70	95.31	94.83	94.98	93.41	93.65	93.94
213	372	32	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	94.18	95.91	93.82	94.43	94.20	93.51	93.96	93.98	94.52	94.68	95.93	93.69	94.72	95.54	93.23	94.42	95.54	96.04	94.59	94.47	93.89	94.01	95.21	95.16	95.33	91.51
214	372	32	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	95.11	93.36	94.55	94.67	95.58	92.98	94.05	93.05	95.43	94.99	94.18	93.46	94.65	95.30	94.50	94.82	94.70	93.14	93.85	95.02	94.79	94.67	94.47	94.00	95.14	93.75
215	372	32	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	93.44	94.63	95.68	93.45	94.92	93.78	94.50	94.11	94.92	94.36	94.89	94.25	94.43	94.14	92.83	94.76	93.72	94.54	94.31	94.41	95.52	94.68	94.70	94.32	94.85	95.23
232	372	32	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	95.02	94.86	95.52	94.03	94.51	94.23	93.97	94.05	93.90	49.17	93.97	93.08	94.21	94.51	93.39	94.65	95.33	94.14	93.65	93.91	95.07	93.43	94.69	95.19	94.59	93.72
233	372	32	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	94.99	94.69	94.61	93.99	94.96	92.49	94.07	93.79	94.42	92.67	94.15	94.30	94.68	94.66	92.79	95.80	95.07	95.01	93.57	94.35	94.28	94.22	94.68	94.47	94.26	93.52
234	372	32	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	94.42	94.06	95.52	94.58	95.14	92.35	95.21	92.82	95.14	93.83	93.89	95.04	94.65	94.04	94.58	94.05	94.39	95.67	93.16	93.71	94.71	94.16	94.39	94.61	95.06	93.35
235	372	32	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	94.24	94.97	95.39	94.81	94.14	93.27	94.03	94.36	95.02	94.56	93.31	94.30	94.61	94.80	93.20	94.17	93.97	95.27	93.71	94.15	95.07	94.03	94.20	94.89	93.96	94.38
252	372	32	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	95.30	94.82	94.73	94.45	94.34	94.16	95.16	94.46	93.42	94.04	94.80	94.73	94.91	94.32	95.00	94.62	94.98	94.09	94.13	95.95	95.50	94.39	94.27	93.84	95.07	95.70
253	372	32	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	94.55	95.68	93.01	95.89	94.03	94.41	94.11	95.72	94.63	94.46	93.80	93.25	94.54	94.09	92.90	95.02	94.10	94.96	93.66	94.53	95.00	94.63	95.93	95.91	95.55	95.14
254	372	32	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	93.62	94.05	92.94	95.08	93.40	95.12	94.52	92.81	93.84	95.11	94.66	92.80	93.13	93.12	93.05	94.21	95.25	94.03	93.71	92.73	93.90	95.23	95.57	94.92	94.44	94.54
255	372	32	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	93.42	94.48	94.27	94.42	93.90	94.29	94.73	94.18	94.97	94.30	93.03	94.23	94.65	93.95	94.85	96.02	94.09	94.92	95.20	94.44	93.86	94.71	95.19	95.17	94.39	94.88
272	372	32	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	94.63	95.72	94.84	93.89	93.12	93.91	93.85	95.20	95.15	94.37	94.44	94.46	93.97	94.86	94.60	95.25	95.37	95.05	94.56	94.46	95.77	93.89	94.97	94.63	95.18	93.91
273	372	32	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	95.37	95.21	96.00	94.14	95.49	94.64	94.63	94.33	93.87	94.42	95.58	93.93	93.90	95.18	94.72	94.60	95.29	94.83	94.47	94.21	95.48	95.57	95.82	94.91	93.73	94.03
274	372	32	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	94.42	94.39	94.18	95.08	94.24	94.34	92.90	92.84	94.40	93.83	94.96	92.76	93.91	94.99	94.52	94.06	94.53	94.50	93.27	94.46	94.66	95.51	93.95	93.85	95.07	93.49
275	372	32	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	94.55	95.51	94.49	95.21	94.01	93.92	94.42	93.77	92.03	94.49	93.96	94.25	94.67	94.73	93.41	94.11	95.49	94.84	94.64	94.49	95.51	95.31	95.22	93.57	95.05	94.66
292	372	32	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	94.60	95.12	95.16	93.16	95.72	94.01	94.32	95.51	94.99	93.98	94.35	92.75	94.31	94.60	93.23	94.63	95.06	94.03	95.15	95.32	95.15	94.22	94.86	94.66	94.43	94.53
293	372	32	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	95.83	93.80	94.99	93.26	94.72	94.58	94.64	93.56	93.14	94.84	93.14	94.36	94.34	94.27	94.69	92.93	93.02	95.65	94.31	93.75	95.02	94.67	94.97	94.04	94.36	94.07
294	372	32	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	95.47	94.41	94.49	93.71	93.84	94.12	94.80	94.90	94.72	92.67	93.30	93.83	94.53	94.42	94.43	93.55	93.38	94.04	93.31	94.42	95.24	94.16	95.84	95.67	94.59	94.35
295	372	32	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	94.65	93.98	93.93	93.90	94.78	93.72	95.00	94.99	93.91	93.88	92.95	93.32	94.37	92.69	93.15	95.04	95.06	93.50	93.66	93.24	94.86	95.79	96.07	94.21	94.63	94.26
312	372	32	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	93.24	91.11	92.96	92.55	92.83	92.92	91.19	94.14	93.14	93.50	92.89	94.46	93.20	94.49	92.90	93.09	92.57	92.22	93.42	91.42	95.07	94.69	91.48	95.32	94.43	92.95
313	372	32	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	92.47	95.72	93.88	92.21	92.71	92.05	92.73	92.55	92.79	92.75	93.16	92.19	93.12	93.62	93.52	94.07	94.41	93.00	93.24	92.98	94.00	93.62	95.19	94.02	95.10	93.62
314	372	32	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	94.17	93.47	93.95	94.25	92.40	93.23	94.22	93.86	91.28	94.43	93.85	94.42	93.98	94.65	92.42	94.68	93.28	93.18	93.80	94.25	94.40	95.51	95.35	94.18	95.11	93.44
315	372	32	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	93.79	94.11	94.01	93.30	92.50	93.12	92.54	92.85	93.61	94.56	94.90	95.34	93.31	93.44	93.96	94.59	94.89	92.39	94.14	93.35	94.30	93.73	94.97	94.75	94.29	94.23
332	372	32	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	95.64	94.41	95.83	94.58	95.06	94.22	93.36	91.71	92.46	94.32	93.44	93.98	94.27	94.51	92.88	92.61	94.06	93.83	93.77	94.09	95.09	94.90	95.91	93.95	94.89	93.80
333	372	32	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	95.62	93.57	95.11	93.66	92.78	95.00	95.48	93.56	94.06	93.00	95.10	93.37	93.15	94.81	93.92	94.22	94.02	94.46	92.53	94.62	94.40	95.95	95.91	93.96	95.38	94.47
334	372	32	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	94.07	94.81	94.84	94.45	93.22	94.13	93.96	95.23	91.55	93.52	92.96	93.89	95.07	95.59	93.57	93.86	94.56	93.36	93.62	94.37	95.05	95.52	94.52	94.99	93.87	94.72
335	372	32	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	93.86	94.91	94.81	94.22	95.39	94.12	93.73	94.31	94.41	93.48	93.73	92.55	94.09	95.26	94.01	94.28	94.69	93.74	94.40	93.42	94.26	94.24	94.02	95.31	94.87	93.24
352	372	32	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	95.14	94.07	92.82	93.09	93.43	49.17	92.47	92.61	93.97	93.93	93.45	92.60	93.58	93.11	92.67	93.47	93.11	92.97	93.15	94.59	94.58	94.88	95.32	94.29	94.96	93.22
353	372	32	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	94.30	94.85	92.61	94.61	95.63	92.49	93.27	93.57	90.77	95.03	93.40	92.91	94.21	94.79	92.99	93.80	94.17	93.24	91.68	93.13	94.69	93.84	94.79	94.60	93.74	94.43
354	372	32	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	94.91	92.67	95.25	92.79	94.46	93.45	92.32	93.90	93.42	94.19	92.07	93.72	93.90	93.47	93.75	94.49	94.68	92.69	93.70	93.49	94.37	95.65	95.29	94.51	92.48	94.15
355	372	32	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	94.23	94.13	94.99	94.01	93.47	93.69	93.41	94.10	94.36	93.27	93.97	94.33	94.91	92.87	91.26	93.51	93.23	93.02	92.19	93.47	94.71	95.53	95.27	92.93	95.24	94.65
372	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	92.62	93.94	92.96	93.84	92.92	93.11	92.22	93.02	91.88	93.04	92.81	92.22	92.47	92.03	92.54	92.18	93.41	91.85	92.68	91.51	93.00	92.05	93.15	92.29	92.48	92.10
373	372	32	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	91.46	93.25	93.56	92.98	92.79	92.32	92.58	91.03	93.22	93.91	91.56	91.95	93.82	93.10	91.23	93.06	93.14	92.24	93.15	92.45	90.96	92.92	93.78	92.53	92.59	93.26
374	372	32	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.17	93.16	92.47	93.82	92.47	92.50	92.80	92.81	92.87	92.95	92.27	93.31	92.69	92.55	92.59	93.93	93.58	93.22	92.59	92.36	93.40	93.58	92.92	93.13	93.22	92.82
375	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.76	94.02	90.67	92.32	92.61	91.57	91.40	89.77	91.09	92.17	93.43	91.84	92.93	93.52	92.39	93.06	92.74	92.84	93.34	93.23	93.96	92.66	93.26	91.98	91.59	91.33
392	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	93.46	92.75	93.54	93.67	93.31	92.80	91.02	91.81	92.33	92.34	92.68	92.57	91.64	93.88	93.00	92.37	92.23	93.73	94.20	91.79	92.77	92.85	92.11	91.32	92.86	92.92
393	372	32	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	93.59	93.29	93.82	93.15	92.85	91.98	92.52	93.10	92.76	92.51	92.65	92.31	93.29	92.68	93.00	92.78	93.63	92.32	92.26	93.43	92.51	93.06	94.07	91.56	92.52	93.35
394	372	32	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	91.93	92.15	93.70	92.61	92.70	93.76	92.47	92.29	92.41	92.60	92.40	93.84	92.18	93.43	92.90	92.47	93.29	93.74	92.96	90.36	92.79	92.00	93.79	92.89	92.97	91.50
395	372	32	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	93.17	93.77	92.97	93.35	91.66	92.28	93.14	93.38	93.49	92.44	93.57	92.42	92.25	93.03	92.90	93.09	92.50	92.91	93.15	92.31	93.56	93.14	93.34	92.62	92.10	91.56
412	372	32	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	92.42	93.33	93.97	92.67	92.62	92.40	92.91	94.02	92.20	92.97	94.56	93.25	93.13	93.43	93.53	94.03	94.04	93.38	93.71	93.78	93.43	92.94	93.09	92.97	91.00	92.58
413	372	32	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	92.04	93.96	93.85	92.33	93.24	94.11	93.27	92.87	93.06	92.18	93.81	93.08	92.98	93.20	92.67	94.28	93.88	94.05	93.43	93.18	92.80	92.56	92.77	94.27	91.92	93.05
414	372	32	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	91.69	93.93	92.31	92.98	91.72	93.33	91.50	93.09	92.53	92.07	93.77	92.98	91.73	92.84	93.16	91.94	92.05	92.36	92.33	92.28	93.86	92.63	92.84	90.28	92.41	91.72
415	372	32	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	92.51	93.35	92.86	93.83	92.44	94.11	91.50	94.62	92.18	93.23	92.15	92.62	92.30	93.17	92.66	93.45	92.21	92.71	93.54	92.14	94.01	93.29	94.13	93.12	92.55	91.32
432	372	32	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	91.65	92.52	93.99	92.58	93.38	89.28	92.35	92.34	92.07	93.10	89.37	92.69	92.22	94.22	93.42	92.85	94.76	94.03	93.55	92.66	93.06	93.42	93.15	92.14	93.40	91.54
433	372	32	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	92.25	92.76	92.95	93.02	92.18	92.00	92.05	90.16	90.96	93.12	92.19	91.95	92.16	92.56	93.84	93.57	93.23	94.76	92.18	89.13	93.81	91.93	93.74	92.11	91.82	91.53
434	372	32	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	92.55	93.58	93.64	93.40	93.41	93.06	92.52	92.23	91.63	91.65	93.24	92.13	92.84	93.58	92.59	93.59	93.61	94.28	92.10	93.73	93.50	93.33	93.82	92.65	90.82	92.31
435	372	32	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	91.74	94.07	92.17	92.26	92.97	92.65	92.54	93.69	91.94	92.74	93.05	91.93	92.08	92.62	93.21	92.80	93.65	93.00	92.11	92.08	93.10	92.70	93.10	92.27	92.28	91.83
452	372	32	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	92.76	93.95	93.86	92.53	93.19	93.49	92.14	92.72	91.28	91.95	93.74	92.46	90.81	93.62	91.62	93.23	93.24	93.63	93.57	93.87	93.71	93.78	93.46	92.87	92.80	90.79
453	372	32	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	91.62	93.72	93.42	92.98	92.65	92.10	92.55	92.80	92.33	92.20	91.59	91.71	92.11	92.28	92.99	93.92	94.30	93.23	91.87	93.49	93.44	92.84	93.87	93.44	92.07	92.98
454	372	32	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	92.49	93.49	92.33	92.40	92.56	92.32	90.97	92.52	92.04	90.87	92.49	91.93	93.17	93.35	92.38	92.40	93.80	92.45	93.97	92.17	93.58	92.77	93.72	92.27	93.50	92.00
455	372	32	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	91.82	92.67	93.15	92.10	92.36	92.48	91.42	92.26	92.14	91.47	92.62	93.69	92.75	92.28	93.47	92.74	93.25	93.18	93.08	92.39	92.60	93.50	92.84	91.18	92.17	92.55
472	372	32	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	91.21	92.24	92.69	92.76	92.30	93.68	92.28	91.57	92.33	91.82	93.65	92.50	92.98	93.01	92.46	92.65	92.98	93.65	93.77	92.88	92.89	93.43	94.17	93.00	94.30	91.97
473	372	32	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	93.12	93.21	92.65	92.52	93.75	93.90	92.72	92.19	91.38	93.48	93.17	92.59	92.58	91.46	92.76	91.75	93.32	92.96	92.96	93.51	93.42	92.02	92.90	93.03	93.19	92.34
474	372	32	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	91.35	93.32	93.76	93.49	91.60	93.47	93.03	92.69	92.54	92.61	93.15	93.40	93.81	92.16	93.74	92.79	93.41	93.75	92.69	93.31	93.97	92.84	93.42	93.41	91.13	92.77
475	372	32	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	92.62	93.24	94.29	93.51	93.00	92.41	92.30	92.61	91.85	93.11	92.57	91.87	92.74	92.88	92.25	92.30	93.05	93.79	92.62	92.58	92.55	92.78	93.89	91.27	94.52	91.32
492	372	32	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	92.29	93.27	92.66	91.83	93.13	90.89	91.03	92.33	91.90	92.22	93.29	91.84	92.78	93.01	92.61	93.51	93.89	89.89	93.28	88.58	94.47	94.47	93.40	92.15	93.07	93.28
493	372	32	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	92.39	92.92	93.00	94.10	91.90	89.60	89.78	91.72	91.89	92.50	92.90	92.35	91.50	93.58	93.22	91.55	93.43	92.96	93.26	92.92	93.15	92.05	93.80	93.13	91.02	91.83
494	372	32	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	91.72	93.22	89.36	94.17	92.93	92.72	91.40	92.69	92.46	92.32	93.14	91.61	89.44	91.60	92.65	94.83	92.46	92.29	91.01	91.17	93.46	92.25	92.45	91.14	92.26	92.95
495	372	32	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.99	93.08	93.65	92.42	92.27	91.24	92.48	93.17	91.93	92.67	91.53	92.63	90.83	93.43	91.66	92.52	93.15	93.17	92.98	90.50	92.88	93.31	90.58	92.86	92.81	90.96
512	372	32	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	91.23	93.09	92.25	93.75	92.76	92.71	92.85	93.59	91.92	92.48	92.78	92.23	89.70	89.31	92.77	92.49	92.09	92.84	94.22	92.55	93.68	94.07	93.30	93.80	94.02	91.18
513	372	32	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	92.94	92.47	91.87	93.01	93.36	90.54	92.03	94.17	91.58	92.40	88.66	89.90	92.30	93.00	91.14	92.33	93.66	92.76	91.84	92.72	93.81	91.36	93.88	92.88	93.13	88.18
514	372	32	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	92.03	92.53	94.35	93.21	93.03	88.05	90.19	92.41	92.09	91.83	90.82	90.56	92.62	90.66	93.49	92.40	94.54	92.40	91.23	91.42	92.42	93.20	93.41	93.74	92.73	91.70
515	372	32	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	92.55	93.62	93.45	93.23	92.91	91.83	92.22	91.44	92.48	91.09	90.73	91.31	91.81	93.50	94.33	89.71	94.31	93.07	92.16	92.75	93.99	93.76	92.64	89.06	92.50	90.96
532	372	32	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	89.74	92.51	92.26	92.60	93.27	90.65	93.03	93.35	91.39	93.13	92.29	92.22	91.79	91.92	95.19	93.19	93.82	92.86	89.74	91.80	94.31	93.78	93.00	92.95	94.24	92.42
533	372	32	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	92.26	93.77	92.09	92.21	92.86	91.52	93.10	91.72	92.15	92.75	92.83	91.73	93.43	92.75	93.62	92.77	94.30	92.67	91.63	89.08	94.45	92.36	92.27	92.44	91.97	91.59
534	372	32	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	92.32	93.68	92.68	92.63	92.39	92.89	92.09	92.65	92.49	92.82	93.43	92.69	91.98	93.44	75.84	94.66	93.17	93.53	94.15	91.49	93.69	94.23	93.10	93.36	94.98	92.08
535	372	32	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	90.96	94.08	92.37	91.16	93.28	90.48	92.82	92.80	92.27	91.64	93.49	91.86	92.01	93.27	92.86	92.55	93.86	92.85	91.20	91.33	93.92	92.97	93.77	93.59	91.83	92.14
552	372	32	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	92.13	93.78	93.75	93.08	92.45	92.58	91.39	92.14	92.05	93.88	92.43	92.16	91.93	91.57	92.06	93.30	91.82	93.74	93.94	92.50	93.08	93.43	92.61	91.84	92.32	91.27
553	372	32	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	91.13	92.98	92.50	92.76	93.39	92.35	92.77	92.35	90.59	92.42	91.30	93.02	92.62	92.83	92.19	92.13	92.72	95.05	93.34	91.62	92.20	94.07	94.14	92.57	92.71	93.77
554	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	93.36	92.52	93.55	92.88	92.70	91.46	93.50	91.86	92.25	93.12	92.73	91.13	93.00	93.81	93.76	93.24	93.60	94.03	93.68	92.07	92.78	93.27	92.01	92.48	92.77	90.78
555	372	32	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	93.60	93.78	92.18	93.42	93.22	92.89	93.26	93.60	91.91	93.22	93.52	92.63	93.30	91.64	92.10	93.09	94.20	92.08	93.52	92.48	93.53	93.67	93.71	92.49	91.52	91.69
572	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	92.90	93.01	93.06	93.35	93.14	93.90	92.76	93.45	91.76	92.56	92.55	92.57	92.97	91.85	92.32	93.23	93.05	93.06	93.96	92.62	93.13	94.07	93.38	91.65	92.76	90.69
573	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	92.70	92.71	93.42	93.35	90.99	94.44	93.13	92.82	92.10	92.09	92.71	92.94	93.14	94.15	90.89	92.89	92.98	92.37	93.88	93.37	93.94	92.81	93.36	93.20	93.17	91.36
574	372	32	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	92.44	92.04	94.03	92.82	92.56	94.03	92.80	92.28	91.31	93.44	92.44	92.18	92.29	92.56	92.74	93.60	92.24	91.39	94.32	92.94	93.58	90.95	93.26	92.29	92.40	91.98
575	372	32	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	91.47	92.81	93.43	92.56	91.85	93.08	93.35	93.42	92.94	92.36	93.15	93.75	92.50	93.26	91.77	93.13	92.31	93.46	93.68	92.09	93.24	93.74	93.21	92.09	92.12	91.43
592	372	32	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	92.19	93.87	93.25	93.24	93.20	92.75	93.49	91.92	92.09	93.28	94.29	92.14	92.25	91.99	91.93	92.82	93.01	92.22	93.23	93.55	93.43	92.57	92.72	92.44	93.35	92.04
593	372	32	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	93.37	94.56	93.45	93.41	93.68	92.54	94.19	93.05	92.00	91.15	92.93	92.27	91.80	93.14	92.05	91.83	92.81	92.35	94.22	94.47	93.94	92.85	92.37	93.68	93.49	91.41
594	372	32	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	92.18	93.22	94.00	92.98	93.85	92.29	92.65	91.55	93.36	91.70	92.58	93.36	92.40	92.93	92.38	93.68	92.73	92.43	93.58	92.80	93.49	94.09	95.55	94.02	92.69	93.57
595	372	32	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	92.34	92.17	94.00	93.50	93.83	91.84	93.28	93.32	93.46	92.69	93.80	92.56	93.80	94.37	93.36	92.73	92.30	93.54	92.11	92.59	92.65	93.35	92.80	92.59	93.57	92.41
612	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	91.63	93.28	92.44	92.66	93.12	93.83	92.16	92.06	92.50	92.68	91.79	91.90	92.03	92.79	93.40	92.95	93.27	91.39	93.65	92.89	93.70	92.37	93.40	93.51	92.09	91.98
613	372	32	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	92.15	93.69	93.58	93.83	93.48	92.43	92.04	92.43	93.07	92.50	93.86	89.05	92.19	92.79	93.23	93.55	93.58	92.62	94.59	91.04	93.86	92.61	94.73	92.51	93.02	92.03
614	372	32	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	92.08	93.65	91.12	93.12	92.92	93.79	91.58	91.20	90.34	91.48	90.35	90.74	92.33	92.33	91.34	91.52	93.60	93.78	93.13	93.92	93.14	92.84	92.02	92.24	92.10	91.16
615	372	32	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	92.00	93.59	93.08	93.23	92.68	93.17	92.31	92.68	90.01	91.80	92.04	91.18	91.46	93.59	92.23	91.90	93.45	93.24	92.98	92.70	92.83	92.37	93.10	92.60	92.31	90.88
632	372	32	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	93.01	92.67	92.89	92.29	94.26	92.79	92.10	93.33	93.05	92.30	93.24	92.12	91.49	92.26	94.13	93.30	93.30	93.74	92.41	92.90	93.50	94.29	94.33	93.06	92.08	92.77
633	372	32	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	92.34	93.97	92.53	92.59	94.28	93.30	91.50	92.74	90.80	93.52	92.31	91.89	92.13	93.15	92.58	93.17	93.18	93.91	90.27	92.28	93.43	92.71	93.78	92.11	92.64	92.98
634	372	32	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	91.49	93.25	93.34	93.77	92.43	92.42	91.60	92.05	91.85	92.72	89.98	92.30	92.24	93.12	93.52	93.52	92.92	92.75	92.55	91.48	93.72	92.30	94.19	92.12	93.01	91.55
635	372	32	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	92.64	93.38	92.89	91.82	93.24	93.51	92.72	91.97	92.09	92.41	93.19	92.39	91.84	93.14	92.38	92.43	92.56	93.11	92.98	93.15	93.34	93.14	91.95	93.39	93.26	91.11
652	372	32	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	91.06	92.11	92.21	93.36	92.47	93.92	92.61	92.17	92.71	92.58	93.07	92.39	93.24	93.69	93.06	93.45	93.95	93.38	93.83	92.63	93.42	93.17	94.96	92.20	92.44	91.93
653	372	32	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	94.16	92.59	92.40	93.02	93.15	91.42	92.57	91.28	92.51	93.66	93.09	93.09	92.38	92.28	93.11	94.05	92.43	92.97	91.82	92.67	92.97	93.29	93.85	93.04	92.75	91.49
654	372	32	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	91.48	93.92	93.07	92.51	92.60	92.94	92.97	92.43	91.85	91.63	93.45	91.80	92.68	93.57	93.22	93.62	92.89	92.74	94.48	92.44	94.47	94.72	93.19	93.49	92.03	92.05
655	372	32	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	92.77	92.61	93.63	92.90	92.41	92.28	91.57	93.33	91.91	91.50	93.06	92.55	93.03	93.12	93.39	92.61	93.70	93.96	92.42	93.93	92.90	92.93	94.81	92.32	92.32	93.15
672	372	32	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	92.01	93.22	92.70	91.92	93.40	89.86	93.00	91.07	91.05	91.23	91.46	92.19	88.96	93.16	88.34	93.02	93.36	93.16	92.15	92.34	93.68	92.26	93.61	92.21	92.09	91.74
673	372	32	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	92.11	94.26	91.97	92.50	92.16	90.12	91.73	92.52	91.99	93.27	92.91	92.08	92.44	92.69	90.81	90.69	92.70	93.31	93.21	91.26	93.28	92.61	93.38	92.58	93.69	92.43
674	372	32	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	91.27	92.84	93.20	91.90	93.02	92.66	91.67	90.61	92.33	92.94	91.29	91.20	89.93	92.24	92.70	92.15	92.26	91.31	92.82	92.30	89.83	93.98	90.85	92.63	92.93	92.01
675	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	92.17	93.25	92.97	91.47	93.06	90.37	91.78	92.48	91.42	93.27	91.50	91.28	92.25	91.81	93.65	90.17	93.06	93.71	90.02	92.56	93.18	92.74	92.90	93.01	93.17	91.22

Model performance on validation data (T-test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues = []
pvalues_real = []

for _,index in enumerate(dt_valid_sub.index):
  _, p_value = stats.ttest_ind(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')
  pvalues_real.append(p_value)
  pvalues.append((p_value >= 0.05)*1)

  

dt_valid_sub['pvalues'] = pvalues_real
dt_valid_sub['sig'] = pvalues


dt_valid_sub1 = dt_valid_sub.query('sig == 1')


max_indexx = dt_valid_sub1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
554	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	91.75	90.64	91.36	91.45	91.75	91.20	91.25	90.17	90.98	89.98	90.54	91.38	91.75	90.31	91.51	89.48	91.03	91.22	91.14	91.56	90.64	89.42	88.73	89.92	90.82	89.40
612	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	90.00	91.92	89.37	91.29	91.53	91.64	92.37	90.38	90.44	90.78	90.84	91.29	91.31	89.98	92.36	90.55	90.54	90.77	90.28	90.69	90.33	89.57	91.47	89.48	90.19	88.67
675	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	91.33	92.57	90.36	89.78	91.66	90.59	90.68	90.10	90.62	90.86	90.72	90.25	91.34	90.86	88.92	91.57	90.79	91.19	90.60	92.60	89.45	89.23	91.11	89.35	90.39	89.73
372	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	90.09	92.57	90.60	91.64	91.29	90.49	91.30	90.30	92.56	91.06	90.66	90.80	92.14	91.15	89.49	91.71	90.67	92.03	91.53	92.01	90.64	89.94	90.74	89.47	91.11	90.27
375	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.01	90.30	91.57	92.49	91.07	90.89	91.06	89.36	90.73	90.41	90.62	90.39	91.64	91.49	91.10	92.92	91.95	92.75	91.54	92.25	92.30	90.12	89.62	90.15	90.04	89.40
493	372	32	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	90.85	91.30	91.32	92.51	91.26	91.22	91.45	90.01	90.91	89.67	90.45	90.62	92.06	91.58	89.41	90.97	90.43	90.51	91.21	90.39	89.07	89.44	89.74	88.87	90.07	90.33
572	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	91.02	89.65	90.94	92.48	90.98	91.04	89.92	91.06	90.44	90.19	90.91	90.66	92.68	90.84	90.02	91.31	90.20	90.52	91.25	91.03	90.49	90.69	90.09	89.53	91.09	89.77
573	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	89.20	91.69	91.45	90.34	90.87	91.99	91.95	90.83	91.10	90.28	90.25	92.00	91.23	91.03	91.37	91.72	92.25	91.86	91.65	90.60	89.70	89.53	90.03	90.51	90.88	88.93
635	372	32	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	91.72	90.05	89.04	91.42	91.85	90.96	90.56	90.13	90.63	90.12	90.82	91.50	91.61	90.11	90.23	90.75	91.24	90.34	90.52	92.68	89.01	89.66	89.55	90.40	91.30	89.92
392	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	90.38	90.96	90.03	91.43	91.05	91.00	90.18	90.27	91.32	89.70	91.44	90.33	91.55	90.03	90.56	91.28	91.02	91.45	91.81	92.14	90.47	89.75	90.37	89.20	90.39	90.03
393	372	32	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	90.40	90.25	89.79	91.19	91.16	91.14	90.06	90.45	90.08	89.57	91.41	90.35	91.89	91.09	89.16	91.37	91.17	92.56	91.52	91.11	90.27	89.28	90.36	89.24	90.52	90.93
413	372	32	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	89.36	90.63	91.30	91.70	90.86	91.23	90.50	90.58	90.56	90.53	91.08	89.82	91.56	90.29	90.73	90.57	90.72	92.00	90.87	90.46	89.80	91.15	88.26	90.95	90.61	90.65

Size of the All data:  (136, 29)
Size of the Sig data:  (12, 29)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params1 = dt_valid.loc[dt_valid_sub1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params = optimal_params1.reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
3	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	93.36	92.52	93.55	92.88	92.70	91.46	93.50	91.86	92.25	93.12	92.73	91.13	93.00	93.81	93.76	93.24	93.60	94.03	93.68	92.07	92.78	93.27	92.01	92.48	92.77	90.78
6	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	91.63	93.28	92.44	92.66	93.12	93.83	92.16	92.06	92.50	92.68	91.79	91.90	92.03	92.79	93.40	92.95	93.27	91.39	93.65	92.89	93.70	92.37	93.40	93.51	92.09	91.98
8	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	92.17	93.25	92.97	91.47	93.06	90.37	91.78	92.48	91.42	93.27	91.50	91.28	92.25	91.81	93.65	90.17	93.06	93.71	90.02	92.56	93.18	92.74	92.90	93.01	93.17	91.22
0	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	92.62	93.94	92.96	93.84	92.92	93.11	92.22	93.02	91.88	93.04	92.81	92.22	92.47	92.03	92.54	92.18	93.41	91.85	92.68	91.51	93.00	92.05	93.15	92.29	92.48	92.10
1	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.76	94.02	90.67	92.32	92.61	91.57	91.40	89.77	91.09	92.17	93.43	91.84	92.93	93.52	92.39	93.06	92.74	92.84	93.34	93.23	93.96	92.66	93.26	91.98	91.59	91.33
11	372	32	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	92.39	92.92	93.00	94.10	91.90	89.60	89.78	91.72	91.89	92.50	92.90	92.35	91.50	93.58	93.22	91.55	93.43	92.96	93.26	92.92	93.15	92.05	93.80	93.13	91.02	91.83
4	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	92.90	93.01	93.06	93.35	93.14	93.90	92.76	93.45	91.76	92.56	92.55	92.57	92.97	91.85	92.32	93.23	93.05	93.06	93.96	92.62	93.13	94.07	93.38	91.65	92.76	90.69
2	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	92.70	92.71	93.42	93.35	90.99	94.44	93.13	92.82	92.10	92.09	92.71	92.94	93.14	94.15	90.89	92.89	92.98	92.37	93.88	93.37	93.94	92.81	93.36	93.20	93.17	91.36
10	372	32	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	92.64	93.38	92.89	91.82	93.24	93.51	92.72	91.97	92.09	92.41	93.19	92.39	91.84	93.14	92.38	92.43	92.56	93.11	92.98	93.15	93.34	93.14	91.95	93.39	93.26	91.11
5	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	93.46	92.75	93.54	93.67	93.31	92.80	91.02	91.81	92.33	92.34	92.68	92.57	91.64	93.88	93.00	92.37	92.23	93.73	94.20	91.79	92.77	92.85	92.11	91.32	92.86	92.92
9	372	32	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	93.59	93.29	93.82	93.15	92.85	91.98	92.52	93.10	92.76	92.51	92.65	92.31	93.29	92.68	93.00	92.78	93.63	92.32	92.26	93.43	92.51	93.06	94.07	91.56	92.52	93.35
7	372	32	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	92.04	93.96	93.85	92.33	93.24	94.11	93.27	92.87	93.06	92.18	93.81	93.08	92.98	93.20	92.67	94.28	93.88	94.05	93.43	93.18	92.80	92.56	92.77	94.27	91.92	93.05

Size of the test data:  (12, 34)

Difference

diff = dt[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt.columns,test_data_1.columns)):   
   diff[f'col_diff_{i}'] = (np.array(dt[cols[0]]) - np.array(test_data_1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff['negative_count'] = diff.apply(count_negatives, axis=1)
diff.sort_values(by =["negative_count"],inplace = True, ascending=False)

html_table = diff.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

# 
# show(diff)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
675	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.84	0.68	2.61	1.69	1.40	-0.22	1.10	2.38	0.80	2.41	0.78	1.03	0.91	0.95	4.73	-1.40	2.27	2.52	-0.58	-0.04	3.73	3.51	1.79	3.66	2.78	1.49	4
372	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.53	1.37	2.36	2.20	1.63	2.62	0.92	2.72	-0.68	1.98	2.15	1.42	0.33	0.88	3.05	0.47	2.74	-0.18	1.15	-0.50	2.36	2.11	2.41	2.82	1.37	1.83	3
493	372	32	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.54	1.62	1.68	1.59	0.64	-1.62	-1.67	1.71	0.98	2.83	2.45	1.73	-0.56	2.00	3.81	0.58	3.00	2.45	2.05	2.53	4.08	2.61	4.06	4.26	0.95	1.50	3
375	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.75	3.72	-0.90	-0.17	1.54	0.68	0.34	0.41	0.36	1.76	2.81	1.45	1.29	2.03	1.29	0.14	0.79	0.09	1.80	0.98	1.66	2.54	3.64	1.83	1.55	1.93	2
554	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.61	1.88	2.19	1.43	0.95	0.26	2.25	1.69	1.27	3.14	2.19	-0.25	1.25	3.50	2.25	3.76	2.57	2.81	2.54	0.51	2.14	3.85	3.28	2.56	1.95	1.38	1
612	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.63	1.36	3.07	1.37	1.59	2.19	-0.21	1.68	2.06	1.90	0.95	0.61	0.72	2.81	1.04	2.40	2.73	0.62	3.37	2.20	3.37	2.80	1.93	4.03	1.90	3.31	1
573	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.50	1.02	1.97	3.01	0.12	2.45	1.18	1.99	1.00	1.81	2.46	0.94	1.91	3.12	-0.48	1.17	0.73	0.51	2.23	2.77	4.24	3.28	3.33	2.69	2.29	2.43	1
392	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.08	1.79	3.51	2.24	2.26	1.80	0.84	1.54	1.01	2.64	1.24	2.24	0.09	3.85	2.44	1.09	1.21	2.28	2.39	-0.35	2.30	3.10	1.74	2.12	2.47	2.89	1
393	372	32	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.19	3.04	4.03	1.96	1.69	0.84	2.46	2.65	2.68	2.94	1.24	1.96	1.40	1.59	3.84	1.41	2.46	-0.24	0.74	2.32	2.24	3.78	3.71	2.32	2.00	2.42	1
572	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.88	3.36	2.12	0.87	2.16	2.86	2.84	2.39	1.32	2.37	1.64	1.91	0.29	1.01	2.30	1.92	2.85	2.54	2.71	1.59	2.64	3.38	3.29	2.12	1.67	0.92	0
635	372	32	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.92	3.33	3.85	0.40	1.39	2.55	2.16	1.84	1.46	2.29	2.37	0.89	0.23	3.03	2.15	1.68	1.32	2.77	2.46	0.47	4.33	3.48	2.40	2.99	1.96	1.19	0
413	372	32	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.68	3.33	2.55	0.63	2.38	2.88	2.77	2.29	2.50	1.65	2.73	3.26	1.42	2.91	1.94	3.71	3.16	2.05	2.56	2.72	3.00	1.41	4.51	3.32	1.31	2.40	0

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_13	91.730000	0.412068
mAP_valid_abs_values_4	91.476667	0.824162
mAP_valid_abs_values_20	91.460000	0.851298
mAP_valid_abs_values_18	91.433333	0.814040
mAP_valid_abs_values_5	91.277500	0.343647
mAP_valid_abs_values_16	91.183333	0.836827
mAP_valid_abs_values_19	91.160000	0.492323
mAP_valid_abs_values_6	91.115833	0.408221
mAP_valid_abs_values_2	91.044167	0.970684
mAP_valid_abs_values_17	91.000833	0.600052
mAP_valid_abs_values_7	90.940000	0.760574
mAP_valid_abs_values_9	90.864167	0.629176
mAP_valid_abs_values_11	90.811667	0.359743
mAP_valid_abs_values_12	90.782500	0.633118
mAP_valid_abs_values_14	90.730000	0.566649
mAP_valid_abs_values_25	90.617500	0.423258
mAP_valid_abs_values_3	90.594167	0.871242
mAP_valid_abs_values	90.509167	0.842285
mAP_valid_abs_values_15	90.405000	1.059515
mAP_valid_abs_values_8	90.303333	0.428535
mAP_valid_abs_values_10	90.262500	0.486810
mAP_valid_abs_values_21	90.180833	0.886110
mAP_valid_abs_values_23	90.005833	0.918036
mAP_valid_abs_values_26	89.835833	0.668288
mAP_valid_abs_values_22	89.815000	0.583960
mAP_valid_abs_values_24	89.755833	0.627063

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_2	93.252500	0.507527
mAP_test_abs_values_21	93.188333	0.470818
mAP_test_abs_values_17	93.153333	0.480120
mAP_test_abs_values_19	93.111667	1.118854
mAP_test_abs_values_14	93.036667	0.810682
mAP_test_abs_values_3	93.014167	0.848726
mAP_test_abs_values_23	93.013333	0.690485
mAP_test_abs_values_18	92.951667	0.852225
mAP_test_abs_values_4	92.911667	0.815362
mAP_test_abs_values_22	92.802500	0.556795
mAP_test_abs_values_15	92.768333	0.772008
mAP_test_abs_values_5	92.756667	0.678197
mAP_test_abs_values_11	92.729167	0.628236
mAP_test_abs_values_20	92.726667	0.635228
average_map	92.685897	0.263618
mAP_test_abs_values_24	92.649167	0.911467
mAP_test_abs_values_16	92.594167	1.015547
mAP_test_abs_values_10	92.572500	0.387888
mAP_test_abs_values_6	92.556667	1.557739
mAP_test_abs_values	92.521667	0.808746
mAP_test_abs_values_13	92.503333	0.630964
mAP_test_abs_values_25	92.467500	0.691285
mAP_test_abs_values_8	92.244167	0.972751
mAP_test_abs_values_12	92.215000	0.593533
mAP_test_abs_values_7	92.188333	1.063945
mAP_test_abs_values_9	92.094167	0.546301
mAP_test_abs_values_26	91.810000	0.896508

Model performance on validation data (Mann-Whitney U Test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues_mw = []
pvalues_real_mw = []

for _,index in enumerate(dt_valid_sub.index):

  _, p_value_mw = stats.mannwhitneyu(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')#, method = 'asymptotic')
  pvalues_real_mw.append(p_value_mw)
  pvalues_mw.append((p_value_mw >= 0.05)*1)
  

dt_valid_sub_mw['pvalues_mw'] = pvalues_real_mw
dt_valid_sub_mw['sig_mw'] = pvalues_mw

dt_valid_sub_mw1 = dt_valid_sub_mw.query('sig_mw == 1')


max_indexx = dt_valid_sub_mw1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
554	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	91.75	90.64	91.36	91.45	91.75	91.20	91.25	90.17	90.98	89.98	90.54	91.38	91.75	90.31	91.51	89.48	91.03	91.22	91.14	91.56	90.64	89.42	88.73	89.92	90.82	89.40
612	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	90.00	91.92	89.37	91.29	91.53	91.64	92.37	90.38	90.44	90.78	90.84	91.29	91.31	89.98	92.36	90.55	90.54	90.77	90.28	90.69	90.33	89.57	91.47	89.48	90.19	88.67
672	372	32	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	91.18	91.69	90.98	91.08	91.33	90.45	91.31	89.77	90.21	90.69	90.24	91.00	92.15	91.98	90.29	91.35	91.15	90.89	90.51	90.45	88.84	88.51	88.93	88.69	90.98	90.42
675	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	91.33	92.57	90.36	89.78	91.66	90.59	90.68	90.10	90.62	90.86	90.72	90.25	91.34	90.86	88.92	91.57	90.79	91.19	90.60	92.60	89.45	89.23	91.11	89.35	90.39	89.73
372	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	90.09	92.57	90.60	91.64	91.29	90.49	91.30	90.30	92.56	91.06	90.66	90.80	92.14	91.15	89.49	91.71	90.67	92.03	91.53	92.01	90.64	89.94	90.74	89.47	91.11	90.27
375	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.01	90.30	91.57	92.49	91.07	90.89	91.06	89.36	90.73	90.41	90.62	90.39	91.64	91.49	91.10	92.92	91.95	92.75	91.54	92.25	92.30	90.12	89.62	90.15	90.04	89.40
434	372	32	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	89.31	91.43	89.70	91.95	91.17	90.62	90.73	91.32	90.38	91.34	90.56	90.48	91.94	89.94	90.71	91.00	90.91	90.80	91.21	92.02	90.70	90.49	88.38	90.05	88.65	88.90
572	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	91.02	89.65	90.94	92.48	90.98	91.04	89.92	91.06	90.44	90.19	90.91	90.66	92.68	90.84	90.02	91.31	90.20	90.52	91.25	91.03	90.49	90.69	90.09	89.53	91.09	89.77
573	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	89.20	91.69	91.45	90.34	90.87	91.99	91.95	90.83	91.10	90.28	90.25	92.00	91.23	91.03	91.37	91.72	92.25	91.86	91.65	90.60	89.70	89.53	90.03	90.51	90.88	88.93
392	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	90.38	90.96	90.03	91.43	91.05	91.00	90.18	90.27	91.32	89.70	91.44	90.33	91.55	90.03	90.56	91.28	91.02	91.45	91.81	92.14	90.47	89.75	90.37	89.20	90.39	90.03

Size of the All data:  (136, 29)
Size of the Sig data:  (10, 34)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params_mw1 = dt_valid.loc[dt_valid_sub_mw1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params_mw = optimal_params_mw1.reset_index()
optimal_params_mw.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_mw1 = pd.merge(optimal_params_mw, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub_mw = test_data_mw1[list(test_data_mw1.columns[test_data_mw1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
3	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	93.36	92.52	93.55	92.88	92.70	91.46	93.50	91.86	92.25	93.12	92.73	91.13	93.00	93.81	93.76	93.24	93.60	94.03	93.68	92.07	92.78	93.27	92.01	92.48	92.77	90.78
6	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	91.63	93.28	92.44	92.66	93.12	93.83	92.16	92.06	92.50	92.68	91.79	91.90	92.03	92.79	93.40	92.95	93.27	91.39	93.65	92.89	93.70	92.37	93.40	93.51	92.09	91.98
8	372	32	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	92.01	93.22	92.70	91.92	93.40	89.86	93.00	91.07	91.05	91.23	91.46	92.19	88.96	93.16	88.34	93.02	93.36	93.16	92.15	92.34	93.68	92.26	93.61	92.21	92.09	91.74
7	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	92.17	93.25	92.97	91.47	93.06	90.37	91.78	92.48	91.42	93.27	91.50	91.28	92.25	91.81	93.65	90.17	93.06	93.71	90.02	92.56	93.18	92.74	92.90	93.01	93.17	91.22
0	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	92.62	93.94	92.96	93.84	92.92	93.11	92.22	93.02	91.88	93.04	92.81	92.22	92.47	92.03	92.54	92.18	93.41	91.85	92.68	91.51	93.00	92.05	93.15	92.29	92.48	92.10
1	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.76	94.02	90.67	92.32	92.61	91.57	91.40	89.77	91.09	92.17	93.43	91.84	92.93	93.52	92.39	93.06	92.74	92.84	93.34	93.23	93.96	92.66	93.26	91.98	91.59	91.33
9	372	32	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	92.55	93.58	93.64	93.40	93.41	93.06	92.52	92.23	91.63	91.65	93.24	92.13	92.84	93.58	92.59	93.59	93.61	94.28	92.10	93.73	93.50	93.33	93.82	92.65	90.82	92.31
4	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	92.90	93.01	93.06	93.35	93.14	93.90	92.76	93.45	91.76	92.56	92.55	92.57	92.97	91.85	92.32	93.23	93.05	93.06	93.96	92.62	93.13	94.07	93.38	91.65	92.76	90.69
2	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	92.70	92.71	93.42	93.35	90.99	94.44	93.13	92.82	92.10	92.09	92.71	92.94	93.14	94.15	90.89	92.89	92.98	92.37	93.88	93.37	93.94	92.81	93.36	93.20	93.17	91.36
5	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	93.46	92.75	93.54	93.67	93.31	92.80	91.02	91.81	92.33	92.34	92.68	92.57	91.64	93.88	93.00	92.37	92.23	93.73	94.20	91.79	92.77	92.85	92.11	91.32	92.86	92.92

Size of the test data:  (10, 34)

Difference

diff_mw = dt_mw[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt_mw.columns,test_data_mw1.columns)):   
   diff_mw[f'col_diff_{i}'] = (np.array(dt_mw[cols[0]]) - np.array(test_data_mw1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff_mw['negative_count'] = diff_mw.apply(count_negatives, axis=1)

diff_mw.sort_values(by =["negative_count"],inplace = True, ascending=False)


html_table = diff_mw.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

key_values = ['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']
print('Are the keys of the valid and test dfs same?: ',dt_mw[key_values].equals(test_data_mw1[key_values]))

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
675	372	32	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.84	0.68	2.61	1.69	1.40	-0.22	1.10	2.38	0.80	2.41	0.78	1.03	0.91	0.95	4.73	-1.40	2.27	2.52	-0.58	-0.04	3.73	3.51	1.79	3.66	2.78	1.49	4
672	372	32	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.83	1.53	1.72	0.84	2.07	-0.59	1.69	1.30	0.84	0.54	1.22	1.19	-3.19	1.18	-1.95	1.67	2.21	2.27	1.64	1.89	4.84	3.75	4.68	3.52	1.11	1.32	3
372	372	32	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.53	1.37	2.36	2.20	1.63	2.62	0.92	2.72	-0.68	1.98	2.15	1.42	0.33	0.88	3.05	0.47	2.74	-0.18	1.15	-0.50	2.36	2.11	2.41	2.82	1.37	1.83	3
375	372	32	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.75	3.72	-0.90	-0.17	1.54	0.68	0.34	0.41	0.36	1.76	2.81	1.45	1.29	2.03	1.29	0.14	0.79	0.09	1.80	0.98	1.66	2.54	3.64	1.83	1.55	1.93	2
554	372	32	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.61	1.88	2.19	1.43	0.95	0.26	2.25	1.69	1.27	3.14	2.19	-0.25	1.25	3.50	2.25	3.76	2.57	2.81	2.54	0.51	2.14	3.85	3.28	2.56	1.95	1.38	1
612	372	32	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.63	1.36	3.07	1.37	1.59	2.19	-0.21	1.68	2.06	1.90	0.95	0.61	0.72	2.81	1.04	2.40	2.73	0.62	3.37	2.20	3.37	2.80	1.93	4.03	1.90	3.31	1
573	372	32	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.50	1.02	1.97	3.01	0.12	2.45	1.18	1.99	1.00	1.81	2.46	0.94	1.91	3.12	-0.48	1.17	0.73	0.51	2.23	2.77	4.24	3.28	3.33	2.69	2.29	2.43	1
392	372	32	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.08	1.79	3.51	2.24	2.26	1.80	0.84	1.54	1.01	2.64	1.24	2.24	0.09	3.85	2.44	1.09	1.21	2.28	2.39	-0.35	2.30	3.10	1.74	2.12	2.47	2.89	1
434	372	32	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.24	2.15	3.94	1.45	2.24	2.44	1.79	0.91	1.25	0.31	2.68	1.65	0.90	3.64	1.88	2.59	2.70	3.48	0.89	1.71	2.80	2.84	5.44	2.60	2.17	3.41	0
572	372	32	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.88	3.36	2.12	0.87	2.16	2.86	2.84	2.39	1.32	2.37	1.64	1.91	0.29	1.01	2.30	1.92	2.85	2.54	2.71	1.59	2.64	3.38	3.29	2.12	1.67	0.92	0

Are the keys of the valid and test dfs same?:  False

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_13	91.773	0.458501
mAP_valid_abs_values_20	91.535	0.781270
mAP_valid_abs_values_4	91.393	0.855051
mAP_valid_abs_values_18	91.348	0.689151
mAP_valid_abs_values_2	91.342	0.953785
mAP_valid_abs_values_16	91.289	0.882452
mAP_valid_abs_values_5	91.270	0.297508
mAP_valid_abs_values_19	91.152	0.523318
mAP_valid_abs_values_7	91.075	0.744569
mAP_valid_abs_values_17	91.051	0.621422
mAP_valid_abs_values_6	90.991	0.507465
mAP_valid_abs_values_9	90.878	0.687230
mAP_valid_abs_values_12	90.858	0.561383
mAP_valid_abs_values_14	90.761	0.689516
mAP_valid_abs_values_11	90.678	0.345472
mAP_valid_abs_values_3	90.636	0.759637
mAP_valid_abs_values_15	90.633	1.014255
mAP_valid_abs_values_10	90.529	0.507487
mAP_valid_abs_values_25	90.454	0.740168
mAP_valid_abs_values	90.427	0.863430
mAP_valid_abs_values_21	90.356	0.921342
mAP_valid_abs_values_8	90.356	0.586538
mAP_valid_abs_values_23	89.947	1.031989
mAP_valid_abs_values_22	89.725	0.632073
mAP_valid_abs_values_24	89.635	0.528105
mAP_valid_abs_values_26	89.552	0.597472

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params = dt_valid.loc[dt_valid_sub_mw1.index].iloc[:, :6].reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, how='left')
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]
test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_2	93.229500	0.587332
mAP_test_abs_values_23	93.174000	0.755434
mAP_test_abs_values_19	93.073500	0.974681
mAP_test_abs_values_17	93.070000	0.602427
mAP_test_abs_values_21	93.014500	0.988853
mAP_test_abs_values_18	92.963500	0.942921
mAP_test_abs_values_3	92.946500	0.827181
mAP_test_abs_values_22	92.895000	0.767737
mAP_test_abs_values_4	92.867000	0.652562
mAP_test_abs_values_14	92.829750	0.723622
mAP_test_abs_values_5	92.709000	0.607795
mAP_test_abs_values_10	92.701500	0.672399
mAP_test_abs_values_16	92.685500	0.936989
average_map	92.593635	0.276937
mAP_test_abs_values_25	92.550750	0.615677
mAP_test_abs_values_24	92.424500	0.483560
mAP_test_abs_values_6	92.405750	1.353804
mAP_test_abs_values_7	92.401500	0.639642
mAP_test_abs_values_11	92.333250	0.916161
mAP_test_abs_values_20	92.319250	0.900132
mAP_test_abs_values_13	92.257500	1.086067
mAP_test_abs_values_15	92.227750	1.225330
mAP_test_abs_values_8	92.197000	1.058066
mAP_test_abs_values_12	92.166750	0.893815
mAP_test_abs_values	92.164500	0.716784
mAP_test_abs_values_9	91.955750	0.818397
mAP_test_abs_values_26	91.871000	0.755794

Summary using radar plot

def extract_number(text):
    if isinstance(text, str):
        matches = re.findall(r'\d+', text)
        return int(matches[0]) if matches else 1
    return 1

res_valid1['id'] = res_valid1.index.to_series().apply(extract_number)
res_test1['id'] = res_test1.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid1,res_test1])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test1 = res_test1.sort_values(by=['id']).reset_index().query("index !='average_map'")
data_range1 = np.array(list(res_test1['mean']) + list(res_valid1['mean']))
categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test1['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid1['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "T-Test",
        'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range1.min()), round(data_range1.max()) + 1]
    )),
  showlegend=True
)

fig.show()

##############


res_valid2['id'] = res_valid2.index.to_series().apply(extract_number)
res_test2['id'] = res_test2.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid2,res_test2])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test2 = res_test2.sort_values(by=['id']).reset_index().query("index !='average_map'")

data_range2 = np.array(list(res_test2['mean']) + list(res_valid2['mean']))

categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test2['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid2['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "MU-Test",
         'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range2.min()), round(data_range2.max()) + 1]
    )),
  showlegend=True
)

fig.show()

Bit size 48

The results in this presentation are from two experimental designs:

::: {.panel-tabset}

Experiment 1 Results

The thresholding is based on fixed values between -1 and 1 on a step size of 0.1.

Validation Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
16	372	48	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	86.47	88.84	87.86	87.13	87.81	88.66	87.92	87.08	89.56	88.78	89.57	89.68	89.48	88.52	89.32	91.15	89.03	89.11	89.43	89.40	89.19	88.18	88.55	88.73	89.70	88.06
17	372	48	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	87.37	87.75	88.17	87.21	87.52	89.06	88.30	89.54	89.04	90.14	88.63	88.99	88.77	89.29	88.48	90.14	88.87	90.35	89.54	86.78	88.97	88.99	88.99	88.77	88.58	89.02
18	372	48	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	88.43	87.77	88.99	87.52	88.64	89.22	88.21	42.66	88.42	89.44	84.97	89.57	88.51	89.80	89.59	90.78	90.22	89.70	88.61	89.15	42.66	89.80	87.76	89.72	89.12	87.89
19	372	48	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	88.59	88.12	88.46	86.03	87.82	89.99	89.71	89.49	88.33	89.68	88.98	89.28	89.09	88.60	88.27	89.44	88.13	89.58	89.20	90.22	87.76	42.66	89.77	88.22	88.66	89.58
36	372	48	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	87.33	89.71	88.75	88.99	88.99	89.18	89.78	90.62	90.37	89.01	90.06	89.69	90.92	89.32	90.35	90.68	90.74	89.01	89.29	89.51	88.93	89.29	88.66	88.89	89.16	88.96
37	372	48	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	88.37	89.19	88.17	88.51	42.66	89.79	89.57	90.09	90.24	88.23	89.84	89.95	89.77	90.52	89.94	90.84	90.21	89.11	89.23	90.01	89.33	89.73	89.01	88.81	88.54	88.36
38	372	48	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	88.49	88.75	86.80	87.58	88.45	89.08	88.91	90.45	90.35	89.03	89.66	90.02	89.97	90.08	89.00	90.26	90.14	89.31	90.04	90.93	88.60	88.95	87.75	89.17	89.58	88.40
39	372	48	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	88.62	89.73	89.11	89.02	88.25	89.64	90.52	89.81	90.16	89.30	89.79	89.48	90.42	89.38	90.42	90.77	90.45	90.70	89.06	90.80	89.13	89.70	88.82	89.54	88.31	90.15
56	372	48	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	90.36	90.62	90.47	89.32	90.28	88.85	89.55	89.68	90.37	88.89	88.84	90.34	89.79	90.82	90.09	91.18	90.68	89.47	89.00	89.41	90.37	88.80	89.53	88.85	88.60	90.20
57	372	48	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	90.14	88.97	89.96	89.79	88.68	42.66	90.82	89.34	90.06	91.00	90.61	89.11	90.35	89.96	89.48	89.97	89.37	89.86	88.72	89.79	88.63	89.78	90.98	89.48	89.26	89.66
58	372	48	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	88.93	88.73	90.12	89.71	89.38	90.69	89.23	89.51	90.43	88.97	89.23	88.69	90.19	42.66	42.66	91.24	89.79	89.99	90.19	90.09	88.91	89.23	89.20	89.26	89.17	88.47
59	372	48	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	89.95	88.94	89.69	90.39	89.61	89.63	90.05	89.92	88.95	89.20	90.34	90.69	90.41	89.71	90.82	90.72	89.55	91.92	90.16	90.03	89.45	89.10	89.62	88.75	88.83	89.70
76	372	48	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	89.41	88.29	88.91	88.92	89.01	88.43	89.69	90.57	89.28	89.12	90.23	89.88	90.10	88.26	89.66	89.25	90.33	90.37	90.38	90.19	89.08	89.16	88.51	87.45	89.37	88.81
77	372	48	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	88.80	42.66	88.41	86.62	88.49	88.94	88.39	90.66	89.84	89.17	90.20	90.85	89.60	90.18	90.26	91.44	90.24	89.28	91.11	89.74	89.58	88.87	89.50	88.81	89.90	88.53
78	372	48	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	88.00	89.69	88.45	87.17	86.94	88.54	90.35	89.72	88.86	89.09	89.78	90.14	90.57	90.06	89.03	89.86	89.69	89.37	89.68	88.82	87.78	88.31	88.88	89.85	88.25	89.15
79	372	48	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	90.96	88.68	88.32	88.16	89.61	88.49	89.71	89.63	90.03	90.10	90.62	89.94	89.83	88.67	90.03	90.41	89.67	90.56	88.96	91.17	88.60	88.35	89.66	90.01	89.50	88.70
96	372	48	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	90.16	89.65	89.99	89.05	90.39	89.48	90.77	89.58	90.85	89.66	89.71	90.84	89.92	89.63	90.48	90.71	91.37	89.58	90.75	90.04	87.97	89.29	90.41	89.60	89.11	89.83
97	372	48	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	89.95	89.09	90.18	90.14	89.86	89.61	89.71	90.62	90.40	91.00	90.44	88.84	90.82	89.23	90.32	91.26	90.79	90.47	88.94	89.59	90.37	89.95	88.86	89.52	89.54	89.90
98	372	48	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	88.06	90.75	89.16	89.93	90.72	89.78	91.89	89.94	90.81	90.45	89.44	90.33	90.87	89.39	89.91	91.09	90.57	89.92	90.29	90.29	89.08	89.56	89.71	89.43	89.37	89.90
99	372	48	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	89.51	90.91	90.07	88.48	89.07	90.75	90.88	90.52	90.03	90.87	89.63	90.34	90.47	90.52	89.97	91.56	90.41	90.36	90.57	91.24	90.91	89.52	89.55	89.16	88.79	88.09
116	372	48	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	89.97	90.36	90.42	89.22	89.98	89.81	89.83	90.02	90.02	90.45	91.53	89.63	90.59	90.57	90.38	90.67	90.66	90.48	90.56	89.80	90.15	89.17	88.43	90.32	90.00	89.29
117	372	48	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	89.54	89.49	89.62	89.48	90.04	88.83	90.03	90.51	90.40	90.01	89.84	91.03	90.62	89.82	91.44	90.94	90.25	91.24	90.32	91.17	89.99	88.26	89.23	89.26	90.10	88.67
118	372	48	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	89.84	90.17	90.52	89.77	89.45	89.37	89.79	90.55	90.85	90.35	89.98	90.32	91.86	90.74	90.44	92.91	90.66	91.31	89.89	91.43	90.06	90.08	89.60	90.19	89.23	89.59
119	372	48	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	88.22	90.95	90.25	89.55	89.66	90.90	90.49	90.54	90.84	89.55	89.73	89.61	91.47	89.61	90.50	91.06	90.34	90.60	91.00	89.35	89.15	90.67	90.17	90.83	89.10	89.78
136	372	48	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	89.13	89.03	88.86	87.16	88.19	89.46	88.48	90.65	90.11	88.53	88.77	89.48	90.97	89.87	90.72	91.04	89.84	90.44	88.91	89.68	89.47	89.63	89.99	89.99	90.16	88.33
137	372	48	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	88.78	89.36	89.42	89.50	88.62	90.10	90.45	90.06	89.98	91.05	89.89	90.87	90.65	90.29	90.14	90.66	90.61	90.92	90.58	90.17	88.92	89.40	89.18	89.21	88.82	89.72
138	372	48	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	88.30	88.86	89.03	88.92	88.16	89.50	90.27	42.66	91.12	89.54	89.26	90.18	90.00	89.20	90.01	90.55	88.40	90.62	89.84	89.89	89.42	88.33	90.37	88.52	89.03	88.84
139	372	48	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	88.26	89.22	89.14	88.69	88.49	89.33	88.98	90.66	90.02	90.39	88.16	88.33	91.27	89.16	89.64	90.79	89.67	91.72	89.19	89.37	90.11	90.08	90.54	88.92	89.22	88.73
156	372	48	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	89.56	90.52	90.86	89.56	89.16	90.51	90.42	90.96	90.27	90.63	89.42	89.25	91.92	90.97	90.90	91.62	90.65	89.99	88.39	90.80	90.23	89.94	88.65	89.04	89.76	89.36
157	372	48	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	88.62	90.35	90.54	89.76	89.14	89.84	90.28	90.37	89.58	89.82	90.41	88.99	90.71	91.37	90.64	90.16	90.70	90.99	90.11	91.14	91.92	89.89	90.50	89.95	89.89	87.94
158	372	48	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	89.13	90.49	89.55	89.53	89.49	90.00	91.08	90.33	91.11	90.89	89.18	90.50	90.83	91.29	89.96	91.36	90.22	90.71	89.21	90.23	91.14	89.32	88.74	88.89	91.32	89.66
159	372	48	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	89.28	89.95	90.35	90.76	89.22	89.41	90.26	91.08	90.24	89.99	90.44	89.92	91.25	89.68	90.32	91.05	89.78	91.83	91.29	91.08	89.06	88.16	90.71	88.70	89.94	89.02
176	372	48	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	89.24	91.29	90.66	89.94	91.10	89.17	89.39	90.03	90.86	90.69	90.17	89.92	88.93	90.99	90.99	90.51	90.95	90.89	90.02	89.94	90.26	89.79	91.11	90.10	89.51	89.25
177	372	48	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	91.57	90.05	90.25	90.50	91.89	90.12	90.62	90.54	90.49	90.09	89.63	90.56	90.43	89.87	90.12	90.07	90.16	90.09	90.82	90.33	89.21	89.18	88.91	88.85	89.84	87.96
178	372	48	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	89.30	90.26	89.62	89.49	91.35	90.22	90.19	91.16	89.79	91.02	89.50	91.74	91.20	91.27	89.99	90.62	89.67	91.47	89.52	88.68	89.87	88.81	88.48	89.73	90.13	88.72
179	372	48	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	88.94	90.64	91.86	90.94	87.99	89.76	89.68	90.97	91.45	90.42	90.08	90.01	90.99	90.11	90.46	90.87	91.30	91.69	90.24	90.25	88.60	89.35	89.55	89.46	90.37	89.01
196	372	48	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	87.81	87.26	88.65	86.79	88.18	89.68	89.05	89.92	88.46	88.22	88.82	89.38	90.12	89.44	87.16	90.69	89.37	90.36	89.56	88.89	89.11	89.22	88.58	88.62	90.33	88.53
197	372	48	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	88.70	88.94	88.38	89.49	89.33	88.59	89.10	89.95	90.16	89.81	90.24	90.94	90.00	90.53	88.21	89.45	87.02	89.55	90.10	88.94	89.58	88.41	89.99	88.32	88.82	89.10
198	372	48	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	86.66	88.73	87.87	87.38	87.38	90.74	89.64	89.40	90.23	88.61	89.10	89.42	89.14	89.58	88.58	89.76	88.99	91.15	90.07	89.41	89.15	88.65	90.38	88.85	88.95	87.98
199	372	48	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	87.65	88.97	89.22	88.27	89.11	89.44	89.19	89.40	89.38	88.90	88.90	89.18	90.36	88.75	89.58	89.54	89.52	89.77	90.85	90.04	91.89	89.00	90.20	88.91	89.03	89.22
216	372	48	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	89.18	89.68	89.35	88.49	88.84	89.78	89.03	90.74	90.76	90.78	89.02	89.35	90.04	90.18	90.22	88.81	89.12	91.17	89.92	89.15	89.72	90.07	90.28	89.49	88.80	87.97
217	372	48	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	89.54	89.20	89.30	89.95	89.15	90.20	88.98	90.44	89.64	89.78	90.18	89.18	90.78	90.68	90.30	90.43	90.90	89.49	89.83	90.72	88.98	88.63	90.11	88.89	88.84	88.46
218	372	48	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	88.78	89.82	87.81	89.11	89.77	89.02	89.00	90.55	89.99	89.50	89.33	90.10	90.29	88.87	90.12	90.64	89.96	91.00	89.04	89.99	89.22	89.19	88.84	89.41	89.62	89.35
219	372	48	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	89.61	90.99	88.67	88.94	89.92	89.34	89.30	89.43	90.25	90.85	89.33	89.48	90.99	89.41	89.27	91.20	89.92	89.65	91.04	90.57	90.10	90.21	89.00	88.82	89.14	89.97
236	372	48	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	88.80	89.19	89.30	90.01	87.80	89.25	89.22	91.26	90.65	89.33	89.72	90.12	90.24	90.57	90.73	90.63	91.00	90.09	90.06	89.89	89.08	89.21	88.93	89.48	91.28	89.18
237	372	48	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	88.38	89.74	89.36	89.41	90.60	89.48	88.50	90.77	88.95	90.91	90.34	89.83	90.29	90.10	90.61	90.72	90.00	89.64	89.48	89.91	88.76	88.51	89.11	89.47	89.75	88.51
238	372	48	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	89.86	88.69	89.09	89.19	88.79	88.98	90.09	88.94	91.71	89.36	90.26	90.46	90.66	89.91	90.96	90.32	90.12	90.48	90.64	89.03	89.99	89.68	89.39	89.97	88.95	89.91
239	372	48	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	89.05	90.13	90.62	90.04	88.50	90.63	91.53	89.50	90.41	90.89	89.69	89.38	90.98	89.39	89.81	89.31	90.19	90.31	90.70	90.76	90.15	88.56	90.41	88.72	89.41	88.96
256	372	48	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	87.70	88.41	87.65	88.19	89.54	88.52	88.84	90.80	90.41	89.16	88.42	90.68	91.52	89.99	89.40	89.95	89.04	89.00	89.93	89.43	89.27	89.07	88.83	89.50	89.55	88.73
257	372	48	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	89.51	88.12	88.66	88.78	89.32	89.31	90.13	90.24	90.68	89.76	89.95	89.88	91.42	89.74	89.73	89.99	89.33	90.67	90.84	89.50	90.74	89.69	89.64	88.30	89.70	89.40
258	372	48	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	88.68	89.21	88.54	87.43	88.09	89.38	89.24	89.95	90.61	89.20	89.20	90.18	89.61	90.27	91.11	90.88	89.51	90.38	90.71	90.25	89.36	88.79	88.51	87.68	89.94	89.11
259	372	48	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	89.89	89.24	87.92	90.22	89.16	89.50	90.53	90.10	90.42	89.79	89.28	89.91	90.78	90.83	90.12	89.94	89.52	90.69	89.73	90.30	89.45	88.55	89.97	88.76	89.76	88.33
276	372	48	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	42.66	89.45	90.01	88.03	87.73	89.68	89.10	89.21	90.77	90.40	89.76	89.99	90.33	90.11	89.61	90.30	89.96	89.45	89.11	91.11	89.90	89.22	90.19	89.18	89.96	89.22
277	372	48	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	89.64	90.79	89.79	89.85	89.83	89.17	90.65	90.99	89.54	89.65	89.64	91.41	90.66	90.32	90.51	90.35	90.90	90.67	90.11	89.50	89.59	90.46	90.53	90.44	90.09	89.10
278	372	48	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	88.88	88.64	90.72	89.55	89.04	89.66	90.23	90.69	88.86	90.22	90.86	90.26	91.85	90.49	89.90	91.11	88.74	90.90	89.29	89.61	91.13	90.35	87.74	88.29	89.27	89.62
279	372	48	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	89.25	90.29	91.28	90.47	89.64	90.60	90.47	91.01	90.24	89.71	90.61	90.00	90.72	91.18	89.80	91.14	90.59	90.50	90.11	90.49	89.53	89.14	89.61	89.13	89.94	88.93
296	372	48	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	90.12	88.99	90.58	90.26	89.49	90.37	89.91	90.55	89.71	90.13	90.67	90.15	91.90	90.75	88.75	91.15	90.73	91.42	88.61	89.96	88.78	89.72	88.99	88.45	90.77	88.93
297	372	48	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	89.80	89.93	89.39	90.08	89.92	89.62	90.88	90.85	90.87	90.39	89.87	90.85	90.86	91.15	90.11	91.01	90.22	91.11	90.85	90.62	90.59	89.73	88.55	88.59	89.17	89.90
298	372	48	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	90.46	89.76	90.35	90.23	90.03	89.71	89.64	90.24	90.69	89.38	90.55	90.01	89.67	91.14	89.95	89.13	89.28	90.60	90.07	89.97	90.15	90.24	88.85	89.36	89.10	89.61
299	372	48	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	89.57	89.59	91.05	89.87	88.65	89.37	89.22	90.92	90.19	91.35	89.15	90.19	91.47	90.84	89.44	91.34	89.51	91.23	91.14	90.65	89.76	90.08	89.86	88.79	88.57	89.12
316	372	48	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	87.31	89.47	89.08	88.54	88.22	87.91	88.09	89.36	89.31	89.00	90.25	89.72	90.10	89.98	89.48	90.94	89.65	90.38	90.96	90.16	89.97	90.36	88.04	88.61	89.36	88.17
317	372	48	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	88.79	90.39	89.95	88.99	88.18	90.26	90.17	89.37	90.12	90.77	90.09	89.61	90.57	90.76	90.25	90.88	89.92	91.09	90.13	89.22	89.50	90.46	89.50	89.45	89.75	89.15
318	372	48	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	88.86	89.87	89.45	88.57	87.76	89.90	88.94	90.72	90.89	88.71	89.94	89.94	91.56	89.19	89.50	89.67	89.37	90.10	89.70	90.21	89.93	88.50	89.24	88.31	88.95	88.61
319	372	48	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	89.53	88.56	88.26	88.68	88.03	88.55	90.15	89.67	90.48	89.64	90.61	89.31	90.64	89.68	90.30	89.31	90.44	91.00	89.74	88.97	90.39	88.56	89.32	89.09	89.93	88.82
336	372	48	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	89.93	90.54	89.26	88.65	88.09	89.32	90.03	90.78	90.83	90.88	90.05	90.81	90.32	91.17	90.28	90.07	89.77	90.85	89.26	90.87	89.35	90.40	88.10	89.37	88.91	88.63
337	372	48	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	89.19	90.45	89.00	89.96	89.72	88.22	88.88	89.93	90.43	90.37	90.05	91.19	91.48	91.43	89.28	91.41	90.86	90.04	90.54	91.04	90.88	89.65	90.33	89.29	89.58	89.26
338	372	48	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	89.24	90.62	90.80	89.54	90.55	89.39	90.62	90.22	90.55	90.02	90.47	90.53	90.11	90.36	90.25	91.04	90.17	91.09	89.05	89.51	90.26	89.11	88.70	88.24	90.64	88.71
339	372	48	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	90.87	89.29	89.36	89.95	89.04	88.79	89.96	90.11	89.31	90.60	89.62	89.81	90.48	90.71	91.58	90.90	90.06	90.77	90.95	91.14	90.36	88.91	88.14	88.79	90.30	90.09
356	372	48	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	89.72	89.07	91.72	91.07	90.18	90.26	90.74	92.28	89.34	90.56	89.56	90.44	90.54	91.45	90.47	90.54	90.34	90.20	91.06	89.96	89.54	89.33	89.56	88.95	88.81	88.54
357	372	48	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	89.78	89.58	89.95	89.80	88.50	89.22	90.30	89.94	90.38	90.21	89.85	90.41	90.71	91.07	90.78	90.95	90.25	90.80	89.85	90.73	89.67	90.55	88.00	89.92	90.40	89.53
358	372	48	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	89.43	90.08	91.76	89.70	89.90	90.21	90.32	89.67	90.16	91.03	91.23	90.10	90.51	90.33	91.62	92.21	90.27	91.30	90.62	90.27	90.10	89.83	89.62	89.59	89.65	88.81
359	372	48	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	91.54	89.85	89.48	89.52	89.50	88.36	89.38	91.46	90.40	91.22	90.06	89.96	90.62	90.93	90.62	91.72	89.54	90.92	90.05	90.41	90.34	90.05	90.17	89.38	89.47	89.40
376	372	48	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.44	90.75	90.40	92.35	92.51	89.96	90.55	90.05	91.11	90.17	89.63	91.24	92.20	90.89	91.12	91.64	90.84	92.22	91.99	90.94	89.86	90.14	90.06	88.56	90.89	88.86
377	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	91.56	91.91	92.04	90.64	91.37	90.23	91.76	91.36	91.08	91.14	91.77	91.13	90.26	91.77	91.49	92.25	91.87	92.43	90.16	91.44	90.50	90.61	91.21	89.60	91.15	89.77
378	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	91.40	91.50	91.35	90.69	91.50	90.42	91.63	91.32	91.18	91.40	91.41	90.54	91.13	91.94	91.41	91.91	91.47	93.03	90.51	90.92	90.00	89.79	90.45	88.95	91.19	89.22
379	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.62	92.56	90.84	91.64	91.29	91.09	90.15	90.39	92.35	90.29	90.57	91.55	91.77	90.61	90.50	91.57	91.49	91.53	90.13	91.21	89.95	91.26	90.45	90.03	91.04	88.95
396	372	48	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	89.35	91.06	90.10	91.74	90.46	91.14	90.16	89.31	89.06	91.15	90.41	91.01	91.55	90.14	91.33	91.77	90.05	90.12	91.03	91.29	90.35	90.75	90.30	88.60	90.19	90.68
397	372	48	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	90.63	91.87	90.09	92.15	90.67	89.76	90.73	91.59	90.51	90.30	90.29	91.01	91.36	91.11	91.40	92.11	91.40	92.15	90.72	91.74	90.42	89.21	90.26	88.96	90.82	89.95
398	372	48	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	91.12	90.88	89.72	90.84	90.92	90.80	90.37	89.99	90.68	90.46	90.50	90.78	89.88	91.14	91.30	91.00	90.86	92.51	91.00	91.38	90.88	90.01	90.58	90.02	89.36	88.38
399	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	92.31	92.28	90.60	92.56	91.88	91.07	90.66	90.36	90.78	89.62	91.45	90.65	89.87	90.26	90.83	91.70	92.19	90.37	90.12	90.71	91.05	90.79	88.88	90.34	90.69	90.63
416	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	91.50	91.39	92.55	90.52	90.72	90.77	90.73	91.28	89.40	89.14	90.92	91.14	89.97	92.23	90.77	91.95	91.41	91.77	89.91	92.03	91.51	90.87	88.07	89.16	89.84	90.62
417	372	48	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	89.35	91.45	91.27	90.73	89.79	90.23	91.06	91.02	89.91	90.27	90.56	90.68	91.45	90.21	91.36	91.06	90.97	90.81	90.92	90.59	88.84	90.56	89.59	90.83	90.88	90.82
418	372	48	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	90.74	91.20	90.78	91.91	90.56	90.52	90.38	89.87	90.21	91.36	91.35	90.87	91.26	89.40	91.43	90.60	91.91	90.33	91.04	90.85	91.64	90.98	88.20	89.87	91.07	90.06
419	372	48	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	90.11	91.48	91.67	91.21	90.95	89.66	88.98	91.01	90.96	90.38	91.34	89.61	91.72	90.23	89.66	91.36	90.60	91.25	91.57	91.83	89.30	91.19	89.54	89.13	90.77	89.90
436	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	91.23	89.28	90.61	91.42	91.50	90.84	91.26	90.78	89.33	91.48	91.74	91.55	91.03	91.50	90.86	91.82	92.57	92.11	91.25	91.02	90.18	90.32	90.39	90.70	89.09	90.08
437	372	48	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	91.88	92.13	91.39	91.02	90.89	90.25	90.64	90.54	90.97	91.78	89.04	91.69	91.18	91.66	89.96	90.63	89.71	91.62	90.93	91.43	90.57	89.86	90.02	88.25	90.66	90.05
438	372	48	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	91.24	92.20	90.45	90.96	91.79	90.40	90.83	89.91	90.99	90.64	89.64	90.31	90.25	91.25	90.91	91.38	90.97	92.13	91.53	91.85	90.80	90.29	90.17	89.42	89.97	90.44
439	372	48	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	91.42	91.15	89.80	90.94	91.80	91.04	91.50	90.30	90.28	91.01	90.30	91.02	91.50	90.50	91.27	90.89	90.42	90.74	90.10	91.28	90.11	90.25	90.71	90.95	90.41	90.38
456	372	48	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	90.13	92.29	91.11	90.39	92.12	91.59	91.54	89.72	90.95	89.78	90.23	91.21	91.88	91.27	90.16	89.99	89.96	91.05	91.19	90.98	89.60	89.66	91.52	89.67	90.41	88.99
457	372	48	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	90.54	90.59	92.00	91.56	91.71	89.35	90.00	89.79	90.64	90.32	91.75	91.90	92.02	91.14	90.40	91.67	90.30	91.84	90.81	91.08	89.79	89.53	90.46	88.31	91.09	88.99
458	372	48	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	89.14	90.91	90.57	91.56	91.00	89.39	90.75	90.32	89.64	89.76	90.84	90.89	91.91	90.62	90.81	91.21	91.93	91.64	91.30	91.39	89.93	90.99	90.57	89.06	91.58	90.44
459	372	48	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	89.63	90.64	89.73	91.42	89.73	90.53	90.32	90.79	90.56	91.32	91.14	90.92	92.20	90.08	90.46	91.73	91.25	90.35	91.68	91.87	90.58	90.49	89.61	90.65	90.15	89.25
476	372	48	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	90.29	90.71	91.21	90.85	90.87	90.21	89.66	91.62	90.12	89.85	89.90	91.69	90.93	89.94	91.37	90.47	90.58	90.45	91.54	91.29	89.51	90.20	89.82	88.46	91.93	90.74
477	372	48	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	91.26	90.27	90.35	89.51	92.04	90.12	89.99	91.11	91.27	89.84	91.20	90.34	92.11	90.31	90.26	90.44	91.50	90.25	91.15	91.42	90.08	90.90	88.57	89.80	91.12	89.52
478	372	48	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	90.83	91.79	89.81	90.90	91.66	89.73	91.17	91.32	90.32	91.31	90.19	91.11	91.10	90.28	90.25	90.72	91.19	90.58	90.84	91.51	90.58	91.28	90.53	90.70	90.08	90.09
479	372	48	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	91.02	90.66	89.81	90.95	89.83	91.56	90.73	89.79	90.49	90.67	90.36	90.30	92.16	91.10	90.62	90.22	92.56	91.10	91.10	91.30	89.74	90.23	90.58	90.33	91.10	88.65
496	372	48	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	89.78	91.72	90.56	91.09	91.76	89.44	91.55	90.79	91.10	91.48	90.89	90.29	90.52	90.94	91.46	90.48	91.27	92.57	90.32	91.71	90.27	90.83	90.35	89.91	89.61	90.43
497	372	48	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	90.17	91.68	90.42	90.96	90.86	90.70	91.47	90.73	90.20	90.76	89.70	89.92	91.01	90.89	91.61	89.66	92.17	90.70	90.35	92.03	89.96	91.36	91.34	88.91	91.41	91.01
498	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	89.72	91.62	90.05	92.19	91.31	89.95	91.03	90.20	89.94	91.39	90.29	91.01	92.07	90.40	92.11	92.29	92.21	90.49	92.14	91.27	90.98	89.58	90.76	89.46	90.76	90.53
499	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.28	90.54	91.48	92.55	91.48	91.36	90.22	90.64	91.86	91.29	90.60	91.21	90.55	91.29	92.03	90.48	91.76	91.38	91.56	91.55	91.08	89.55	90.00	90.83	90.26	89.87
516	372	48	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	90.71	90.83	90.00	91.52	90.97	90.24	89.93	90.09	89.68	90.10	90.44	90.25	92.00	91.51	89.98	90.94	90.75	91.08	91.03	91.79	90.35	89.04	89.61	89.10	89.37	90.19
517	372	48	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	89.48	90.91	90.43	91.59	90.22	90.48	89.80	90.94	89.32	89.45	91.66	91.68	90.10	90.71	90.59	90.64	89.21	90.95	90.11	91.00	90.67	90.15	89.30	89.72	91.54	89.81
518	372	48	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	91.46	91.00	90.20	91.09	92.80	89.86	89.73	92.02	90.71	91.14	89.11	90.98	90.20	90.74	91.36	90.63	91.34	91.32	90.46	90.41	90.99	90.34	90.41	89.80	90.94	89.59
519	372	48	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	89.06	92.00	90.62	91.70	90.49	91.02	90.96	90.57	90.21	90.41	90.71	89.98	91.56	91.16	90.56	91.93	92.02	91.39	90.62	90.77	90.46	89.74	90.05	89.95	90.59	90.21
536	372	48	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	90.02	90.16	90.34	90.30	91.23	89.80	90.04	91.07	90.71	90.59	90.71	90.13	90.71	90.49	90.33	90.50	91.71	90.20	91.16	90.68	91.05	89.09	90.70	89.36	90.02	90.10
537	372	48	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	88.83	88.80	90.40	89.35	90.67	89.17	90.50	90.07	89.82	90.61	89.49	89.30	90.75	90.05	90.48	90.93	88.99	91.81	89.95	90.77	90.35	90.09	88.70	89.49	89.71	88.80
538	372	48	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	89.33	91.47	90.47	89.88	91.35	89.47	90.27	91.46	90.69	89.61	90.41	91.15	91.67	89.91	90.84	91.64	91.17	91.00	90.04	90.13	90.61	90.97	90.22	91.26	89.57	88.34
539	372	48	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	91.44	90.16	90.50	91.00	89.96	90.40	91.09	89.82	90.79	90.95	91.71	89.91	91.01	90.74	90.43	90.34	91.32	89.96	91.23	90.97	89.56	90.98	89.94	89.61	89.84	90.57
556	372	48	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	89.91	91.75	91.41	91.07	91.21	90.74	91.17	91.16	90.73	89.59	90.73	90.40	92.42	90.44	91.55	90.59	90.63	91.27	91.28	91.87	90.83	90.76	90.71	90.85	90.90	89.04
557	372	48	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	91.22	91.17	90.88	91.70	91.07	90.30	90.84	90.92	90.24	90.44	90.30	91.69	91.39	89.23	91.58	91.69	90.85	89.80	90.86	92.06	89.90	90.20	89.66	90.01	91.02	90.35
558	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	90.71	92.08	92.17	92.21	91.20	90.43	89.63	89.96	91.62	90.42	90.92	91.94	92.41	90.97	90.85	91.38	91.34	89.88	90.61	92.06	91.08	90.65	90.92	89.77	90.10	90.17
559	372	48	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	91.48	90.62	90.50	92.87	91.06	91.40	90.45	90.28	90.78	90.41	89.32	90.91	91.90	90.40	90.43	92.06	89.36	92.28	92.12	90.98	90.72	89.59	89.75	89.18	90.04	89.93
576	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	89.95	91.53	90.64	91.69	92.02	89.86	91.11	90.61	89.22	89.63	90.44	91.46	91.48	91.54	90.87	92.20	91.88	91.28	91.70	89.57	91.69	90.25	89.59	90.89	90.15	90.92
577	372	48	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	92.57	90.50	91.53	90.02	90.30	91.20	91.14	90.00	90.21	89.86	90.75	90.74	90.57	89.61	90.87	91.22	91.74	91.16	90.53	91.09	91.24	91.10	89.77	90.68	91.23	89.39
578	372	48	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	90.30	91.31	91.08	90.71	91.15	89.75	90.28	90.95	90.41	90.10	91.30	90.03	90.75	90.58	90.71	89.86	90.96	91.26	90.06	90.94	90.05	89.42	89.13	90.39	90.57	89.57
579	372	48	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	89.70	91.12	91.74	91.78	91.30	90.96	89.68	91.39	89.87	90.60	90.60	90.90	92.23	90.19	90.10	91.55	90.90	91.72	90.40	91.28	90.21	90.78	89.65	90.54	89.57	90.42
596	372	48	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	90.67	90.60	89.24	90.60	89.41	89.87	89.85	90.75	91.15	89.70	90.25	91.20	90.19	89.63	90.06	91.62	90.36	89.75	90.22	91.37	89.80	90.05	90.33	90.59	89.72	89.34
597	372	48	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	90.16	90.97	90.39	92.00	89.89	91.65	89.81	90.33	90.26	90.95	91.01	91.81	91.23	90.40	92.14	91.47	91.66	90.93	91.31	90.66	91.01	90.84	90.55	89.66	91.83	90.12
598	372	48	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	91.92	89.65	90.33	89.40	90.92	89.06	90.30	90.77	90.47	91.20	90.33	90.51	91.65	90.81	90.48	91.87	91.43	90.91	90.17	91.88	89.60	90.07	90.53	90.75	89.57	88.56
599	372	48	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	89.24	91.29	90.44	91.20	90.80	90.27	91.23	90.70	90.49	90.87	91.88	92.11	89.95	90.07	91.28	90.69	90.85	90.75	90.23	91.62	90.18	91.70	89.51	90.66	90.49	88.84
616	372	48	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	89.45	91.28	91.18	90.63	90.42	90.32	91.74	90.22	90.45	90.52	90.78	90.64	90.97	90.08	89.54	91.66	91.60	91.69	91.41	91.17	89.04	89.82	89.91	90.71	90.72	89.72
617	372	48	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	90.48	91.19	90.08	91.12	91.79	91.09	91.31	89.20	91.21	90.85	90.44	91.79	91.55	89.76	90.56	91.38	91.91	91.81	91.10	91.65	90.69	90.18	90.65	88.80	89.52	89.17
618	372	48	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	91.60	91.69	90.15	90.60	90.77	89.61	91.16	90.47	90.49	90.16	90.37	90.86	91.19	90.69	89.28	91.63	92.23	91.82	91.10	92.32	90.75	89.06	90.38	89.17	90.02	89.17
619	372	48	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	90.89	90.08	91.18	91.57	89.94	89.73	90.54	90.31	90.12	90.08	90.08	90.11	90.81	91.05	92.17	91.94	91.83	91.51	91.69	91.53	90.15	90.78	90.58	90.45	90.52	89.61
636	372	48	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	90.08	91.83	90.89	92.23	91.09	89.61	90.98	90.16	89.95	90.70	90.45	91.18	91.02	90.77	90.68	90.69	91.36	91.77	90.85	90.68	90.24	89.59	88.27	88.88	90.17	89.92
637	372	48	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	91.15	91.73	89.60	92.12	91.56	90.36	90.96	90.03	90.91	90.46	90.99	91.61	91.38	91.56	91.31	91.22	90.97	90.64	91.45	90.78	90.19	89.72	90.05	89.58	89.34	90.06
638	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	90.73	91.68	90.32	90.66	91.62	91.43	89.78	91.51	90.66	90.35	90.70	91.29	91.52	90.67	90.80	91.76	91.89	91.83	91.81	90.11	91.00	90.94	90.01	90.76	91.14	90.84
639	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	89.24	90.84	90.40	91.13	91.27	92.25	90.78	90.94	91.54	90.71	91.04	92.05	91.51	89.95	91.22	92.32	92.12	89.35	91.63	91.76	90.10	91.31	90.76	89.94	90.28	90.18
656	372	48	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	90.55	90.68	90.44	90.32	90.66	90.24	91.10	89.79	90.69	90.50	91.20	91.54	91.68	90.20	91.12	90.62	90.92	91.91	90.45	90.99	90.86	91.00	90.06	89.77	90.77	89.74
657	372	48	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	90.36	91.46	91.24	91.51	91.77	90.31	90.67	90.32	90.39	90.04	90.87	90.70	90.46	89.70	90.62	90.70	90.78	90.57	91.09	90.52	90.68	91.21	89.38	90.86	89.47	90.34
658	372	48	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	90.27	91.46	90.58	91.30	90.45	91.12	91.12	91.22	89.87	90.39	91.48	90.83	91.43	89.95	91.09	92.56	91.30	90.06	90.23	90.78	89.79	90.40	91.09	90.73	90.37	91.89
659	372	48	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	90.64	90.99	91.62	90.23	89.90	91.12	90.50	91.19	89.78	90.09	90.81	91.43	91.01	90.54	91.12	91.27	91.28	91.37	90.82	91.40	90.24	91.61	90.00	89.12	90.49	90.54
676	372	48	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	91.05	89.86	90.50	91.01	91.40	90.89	90.68	90.21	91.55	91.80	90.78	90.69	92.45	90.49	90.19	90.96	92.21	92.13	91.27	91.83	90.82	90.48	90.03	89.36	90.12	90.05
677	372	48	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	91.26	90.84	90.40	90.96	91.75	90.73	90.53	90.55	90.69	90.79	90.84	90.52	91.73	89.67	89.52	90.56	91.00	92.79	92.04	92.03	89.87	89.55	90.84	90.53	91.13	88.61
678	372	48	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	91.23	91.05	91.10	91.33	91.59	90.89	90.55	90.21	89.89	90.67	91.22	89.95	91.32	90.63	90.15	90.20	92.35	90.27	91.25	91.31	89.91	88.71	90.63	89.36	89.94	89.52
679	372	48	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	90.78	91.59	89.97	91.30	91.08	90.25	91.99	91.87	89.91	91.46	91.32	91.38	90.98	90.49	91.32	90.68	90.33	90.65	91.46	91.19	90.59	89.34	90.19	89.17	89.41	90.56

Test Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
16	372	48	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	93.97	94.21	94.57	94.17	94.51	95.33	93.93	94.54	94.51	94.73	93.51	93.80	95.13	94.19	93.89	94.89	95.67	94.41	93.88	94.61	94.92	94.63	94.51	94.69	94.88	94.05
17	372	48	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	94.58	93.93	93.77	93.15	94.01	93.76	92.63	94.54	93.15	93.70	94.41	94.07	94.44	94.89	94.01	94.84	94.16	94.99	94.84	93.93	94.59	94.46	94.66	94.68	94.37	94.18
18	372	48	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	94.87	94.12	93.50	94.04	93.27	94.55	93.64	49.17	93.22	95.41	90.30	94.24	94.42	94.98	94.31	96.36	95.94	93.84	93.91	93.63	49.17	93.70	94.28	94.68	93.90	94.60
19	372	48	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	92.88	93.15	94.75	93.40	93.86	93.99	94.72	94.77	94.09	95.64	94.26	93.60	94.69	95.05	95.04	94.38	94.85	95.07	94.41	95.13	93.65	49.17	95.61	93.79	92.94	94.80
36	372	48	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	94.33	94.28	94.89	94.02	94.10	94.60	94.41	95.61	94.82	94.29	95.52	94.39	94.67	95.19	94.53	94.64	94.21	94.31	93.50	94.79	95.13	94.12	95.03	95.46	95.56	95.10
37	372	48	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	94.54	93.62	94.69	93.67	49.17	94.10	94.85	94.20	95.05	92.99	94.93	94.64	95.53	93.40	93.53	94.77	94.58	94.26	93.15	94.36	94.67	94.61	94.55	94.84	94.57	93.69
38	372	48	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	94.69	93.97	93.12	93.40	94.69	94.78	96.31	95.26	93.58	93.27	95.06	94.17	95.52	93.68	94.82	95.29	95.70	94.69	95.46	94.54	94.05	92.66	94.49	94.42	95.54	94.15
39	372	48	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	94.99	93.01	95.85	95.34	93.62	93.29	94.98	93.48	94.60	94.63	94.23	93.56	94.10	94.06	94.06	94.88	94.84	94.54	93.34	93.05	94.87	94.28	95.24	94.05	95.56	93.83
56	372	48	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	95.54	93.57	94.84	95.09	95.96	93.99	94.01	94.37	93.99	93.75	94.06	94.11	95.15	94.45	94.33	95.55	94.82	94.27	93.74	94.52	94.73	94.54	95.17	94.12	95.37	94.38
57	372	48	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	95.55	94.62	95.80	94.35	94.61	49.17	94.95	94.17	94.51	94.40	93.05	94.12	93.59	94.51	94.12	94.61	95.15	95.86	94.40	93.82	93.61	93.14	94.29	95.03	93.84	94.21
58	372	48	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	95.41	94.18	93.35	94.29	93.64	94.32	94.36	95.11	94.37	93.84	94.88	93.28	93.22	49.17	49.17	94.85	93.88	94.75	94.11	95.35	94.88	95.19	93.20	94.66	94.77	94.37
59	372	48	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	95.23	95.07	94.30	93.56	94.95	94.70	95.60	94.49	94.13	94.67	94.44	94.09	95.48	94.29	94.04	95.12	94.69	94.21	93.33	92.83	94.82	93.47	94.27	94.41	94.41	95.06
76	372	48	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	94.41	94.01	95.70	94.69	93.41	94.30	93.91	94.60	94.36	94.43	94.60	94.07	94.12	95.77	94.91	94.63	94.98	94.87	93.46	93.46	95.16	93.72	94.33	93.94	94.43	95.57
77	372	48	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	94.58	49.17	95.55	92.77	93.52	94.63	94.00	95.31	93.61	93.50	94.03	93.93	94.83	93.86	94.12	93.96	95.16	93.90	95.20	94.18	95.39	95.92	94.38	94.74	95.57	95.72
78	372	48	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	94.36	95.34	93.97	92.78	93.24	93.88	93.54	93.55	92.60	93.91	94.62	94.17	94.76	94.07	93.51	93.24	94.28	94.19	94.84	94.36	94.65	93.81	94.93	94.80	93.92	93.60
79	372	48	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	95.23	93.67	94.34	92.51	93.70	93.97	93.14	93.68	94.34	93.72	93.14	94.62	94.59	93.63	94.71	93.07	93.79	93.96	93.51	95.50	94.26	94.17	94.26	94.33	95.43	93.46
96	372	48	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	95.58	94.74	95.47	94.84	94.50	92.28	94.20	93.64	94.47	95.45	94.97	94.74	94.08	94.50	94.03	93.41	96.57	95.58	93.64	93.87	95.11	93.89	95.78	94.19	93.94	94.86
97	372	48	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	94.67	95.37	95.16	94.62	94.94	94.65	94.51	93.24	93.41	93.98	94.43	93.40	94.53	93.73	93.39	95.37	95.12	94.06	93.41	94.61	94.31	95.25	94.39	94.51	94.47	94.59
98	372	48	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	94.00	95.22	95.32	94.14	94.79	94.44	94.89	94.14	94.33	94.72	94.09	94.76	95.73	94.35	94.39	94.72	93.83	94.91	93.77	94.24	94.52	95.03	94.53	95.27	94.20	95.20
99	372	48	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	95.04	95.70	95.30	93.93	95.01	92.58	93.55	94.35	94.42	94.11	95.26	94.16	93.77	94.82	94.32	93.89	95.20	94.35	94.64	93.63	95.32	94.76	95.02	94.74	93.38	94.00
116	372	48	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	95.84	94.86	93.11	94.83	93.44	93.00	93.42	94.09	93.45	93.92	95.29	93.95	95.07	94.70	94.77	93.31	95.23	94.80	93.49	94.13	95.16	93.03	92.72	95.53	94.64	93.84
117	372	48	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	94.49	95.75	94.42	94.58	94.58	94.97	94.31	93.80	94.22	94.14	93.94	93.90	94.17	92.94	93.07	93.93	93.90	93.56	94.27	94.40	96.33	93.24	94.34	94.57	94.83	94.25
118	372	48	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	95.68	94.64	93.63	94.60	94.32	94.52	94.14	93.94	94.06	94.74	93.94	94.21	94.88	93.76	93.47	94.39	93.88	93.18	93.14	94.33	94.53	94.38	94.84	94.08	93.46	94.60
119	372	48	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	93.77	94.52	94.52	93.32	94.81	93.67	94.84	93.72	94.60	94.33	93.63	92.89	94.12	92.30	93.10	95.29	93.84	95.13	94.83	93.80	95.48	93.52	95.31	94.59	93.96	94.48
136	372	48	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	94.83	94.82	94.35	93.51	94.27	94.09	93.66	94.60	95.61	94.37	94.21	95.29	94.77	94.48	94.03	95.41	94.81	93.24	94.46	93.65	94.82	94.59	94.25	94.20	94.66	94.65
137	372	48	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	93.37	94.70	95.12	95.52	95.61	95.27	94.51	94.58	94.14	94.91	94.95	94.56	94.04	94.22	94.08	94.50	94.47	95.01	95.00	94.39	95.49	94.77	94.75	94.55	93.55	94.35
138	372	48	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	94.01	94.47	94.17	93.66	94.28	93.40	95.16	49.17	93.81	93.71	93.07	95.10	94.92	93.38	94.62	94.15	93.40	95.00	93.98	95.14	95.24	93.97	94.88	94.27	95.48	93.80
139	372	48	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	94.09	93.67	93.90	93.84	93.48	94.00	93.82	93.77	93.32	93.23	93.84	93.86	94.77	93.81	93.67	94.79	94.73	94.56	93.34	94.49	95.39	95.98	94.85	95.58	94.93	94.01
156	372	48	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	95.69	95.63	95.57	95.18	93.75	93.52	93.77	94.37	93.95	94.66	94.96	93.73	95.16	94.65	93.92	93.60	94.01	95.73	93.16	94.67	95.18	95.81	94.07	94.94	94.65	95.05
157	372	48	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	94.65	94.10	96.30	94.63	94.28	94.06	93.55	92.59	94.75	94.42	94.15	93.59	94.43	94.62	94.52	95.11	95.34	94.27	93.55	93.84	95.25	94.40	95.33	95.00	95.26	93.75
158	372	48	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	94.13	95.27	94.06	94.04	95.13	92.82	93.65	94.36	94.96	94.01	92.76	94.20	94.41	94.12	92.89	94.31	94.60	95.97	93.01	93.69	96.25	95.13	95.32	93.83	94.13	93.66
159	372	48	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	93.97	93.86	94.73	93.56	94.32	93.52	93.88	93.66	94.38	93.80	94.41	93.94	95.01	93.79	95.31	94.40	94.22	94.72	94.35	94.28	94.94	94.50	95.02	93.08	94.98	93.96
176	372	48	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	94.77	94.17	94.86	93.93	93.87	93.33	94.45	93.55	94.36	93.82	93.24	93.31	94.33	94.17	92.68	94.55	95.42	93.76	95.14	95.38	94.75	94.47	95.05	93.99	94.46	93.72
177	372	48	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	95.63	94.19	94.83	94.49	94.15	93.95	94.76	93.77	94.47	93.23	94.83	93.77	93.64	93.08	93.20	95.04	94.31	93.32	94.25	93.70	94.83	94.94	94.12	92.66	93.52	94.79
178	372	48	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	94.23	93.83	92.51	94.06	95.65	94.29	94.08	93.76	93.46	94.53	93.88	94.72	93.67	94.22	94.25	95.02	94.61	94.94	94.40	93.62	94.08	93.13	94.71	95.81	95.60	92.45
179	372	48	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	94.27	93.57	95.06	93.84	94.13	93.08	94.92	94.45	94.42	93.88	94.26	93.96	93.41	93.79	94.57	93.48	94.26	93.90	94.45	92.05	94.41	94.33	94.56	93.98	95.25	93.97
196	372	48	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	94.34	94.08	95.25	94.19	94.98	94.00	94.61	93.83	94.58	93.82	93.10	94.71	94.61	94.21	92.16	95.10	96.03	94.70	94.01	93.81	95.61	95.37	94.65	94.85	94.23	94.90
197	372	48	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	95.24	94.41	94.83	94.59	94.59	92.66	94.86	95.00	95.23	95.07	93.71	94.77	95.00	94.94	93.32	94.87	93.36	93.23	93.24	94.77	94.50	94.13	95.19	94.60	94.32	93.67
198	372	48	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	94.23	94.51	95.05	93.95	94.45	94.76	94.99	95.08	94.14	93.61	94.95	95.27	95.73	94.23	94.78	95.10	93.96	95.65	94.78	94.34	95.81	94.63	94.77	94.39	94.29	93.70
199	372	48	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	94.20	93.98	94.07	94.99	94.64	95.03	94.09	94.29	93.35	92.97	94.41	93.95	93.42	93.93	94.01	93.54	94.56	93.89	94.88	94.14	94.78	94.45	95.18	94.19	94.38	94.61
216	372	48	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	95.43	95.02	95.14	94.23	94.38	93.76	93.69	95.15	94.03	94.59	93.87	95.23	95.65	94.74	94.63	95.18	93.85	94.34	95.69	94.00	95.04	94.52	94.76	94.28	94.55	94.33
217	372	48	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	95.25	94.36	94.85	93.56	94.81	93.97	93.59	93.01	92.48	93.29	94.86	93.88	95.47	94.54	94.17	93.25	93.72	94.98	93.43	94.90	95.02	95.73	94.27	93.38	94.32	94.19
218	372	48	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	95.17	95.21	94.68	93.83	94.38	92.86	94.42	94.47	92.93	94.61	93.96	95.20	95.32	94.72	92.35	95.29	94.80	94.85	93.67	94.58	94.29	94.11	94.69	93.67	94.60	94.54
219	372	48	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	95.72	94.33	94.82	94.09	94.51	93.53	95.28	93.52	93.62	95.13	94.05	94.84	94.37	94.22	94.07	94.74	93.99	94.48	93.20	95.20	94.24	93.63	94.62	94.34	93.69	93.48
236	372	48	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	94.06	95.05	95.14	94.15	94.92	93.00	95.46	94.78	93.97	93.96	94.82	93.51	94.70	95.50	92.98	95.23	94.51	94.24	93.92	94.60	94.96	95.18	94.05	93.15	95.34	94.63
237	372	48	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	94.39	94.68	95.57	94.56	94.68	92.91	95.17	94.61	94.82	94.65	93.95	94.59	94.99	95.33	93.60	95.55	94.77	93.89	94.54	94.14	95.31	94.13	95.24	94.59	94.90	94.60
238	372	48	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	95.23	94.32	95.40	94.87	94.37	93.85	95.80	93.77	94.99	93.27	93.62	94.12	94.19	93.91	93.85	95.58	94.80	94.75	93.46	93.15	95.33	94.45	94.52	95.04	94.57	92.65
239	372	48	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	94.60	93.72	95.48	93.76	95.25	93.34	94.74	95.31	94.71	95.23	94.30	93.32	95.73	93.86	92.39	93.92	95.75	94.30	93.54	94.31	95.63	94.10	94.03	94.50	94.60	94.55
256	372	48	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	93.89	94.35	94.37	93.76	93.24	95.06	93.55	94.45	93.66	93.61	95.12	95.26	93.88	95.15	94.37	95.04	95.16	94.55	94.26	93.98	94.01	94.36	95.57	94.46	95.79	94.38
257	372	48	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	95.21	94.12	94.92	94.91	94.19	94.03	94.62	94.33	94.67	93.59	94.85	95.41	94.36	94.30	93.82	93.73	92.96	93.76	93.52	92.60	94.23	93.85	94.38	94.07	95.24	95.32
258	372	48	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	94.94	95.40	93.50	93.81	94.69	94.39	94.06	95.11	95.01	95.12	94.67	93.89	93.67	94.15	93.32	95.10	93.69	94.29	95.30	93.84	94.85	94.72	95.21	94.76	94.23	94.17
259	372	48	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	94.04	94.89	95.31	94.89	96.01	93.62	94.17	93.94	94.94	94.87	94.94	94.95	94.37	94.42	93.73	94.81	94.85	95.12	94.89	94.51	94.94	94.30	95.02	94.76	94.25	93.97
276	372	48	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	49.17	94.48	94.28	93.79	93.20	95.17	93.86	94.78	94.73	93.60	94.10	93.71	93.96	93.15	92.88	94.84	95.36	92.43	93.04	93.24	94.63	94.17	95.98	94.77	94.48	93.65
277	372	48	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	96.41	95.06	94.28	94.56	95.61	92.39	93.86	94.75	92.87	94.36	93.95	95.53	94.97	94.61	94.80	94.12	94.35	94.63	94.76	94.22	95.43	95.82	94.31	93.52	94.89	94.22
278	372	48	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	94.39	94.01	94.74	93.76	94.33	94.32	94.36	95.23	95.72	94.46	94.81	94.09	95.57	94.45	93.78	95.04	95.24	95.17	94.18	93.28	95.16	95.17	94.55	94.77	94.64	95.53
279	372	48	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	94.17	94.05	95.25	95.19	95.05	93.09	93.32	93.26	94.77	94.73	95.24	94.87	95.13	95.39	95.04	94.29	96.04	94.83	94.06	94.46	94.23	94.83	94.90	94.12	95.40	93.79
296	372	48	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	94.89	93.70	95.12	95.01	94.99	93.97	95.17	94.82	94.61	94.14	94.77	93.81	95.43	95.56	93.90	93.36	95.76	93.93	92.61	93.47	94.98	94.55	95.13	94.42	94.40	93.58
297	372	48	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	93.75	94.55	95.26	94.35	94.13	92.64	94.61	94.29	94.77	93.39	93.15	94.25	94.86	94.63	93.95	94.51	93.94	93.65	93.56	94.24	94.50	94.65	95.55	93.45	94.35	94.52
298	372	48	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	94.62	94.97	95.30	93.32	95.24	93.63	94.95	92.99	94.35	94.15	95.09	93.63	93.23	95.08	93.76	94.63	95.01	93.21	94.34	93.37	95.66	95.42	94.48	94.80	95.64	93.70
299	372	48	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	94.41	94.55	95.94	94.07	93.72	94.55	93.47	94.76	94.38	94.49	94.18	94.04	93.73	93.93	93.65	95.15	93.85	93.73	92.35	93.70	94.77	95.07	94.42	95.05	95.53	94.66
316	372	48	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	94.22	93.84	93.97	93.95	93.21	93.57	93.69	94.18	93.57	93.43	96.07	94.67	94.23	94.11	94.55	95.08	93.17	92.62	94.71	94.34	95.04	93.67	95.21	94.31	94.69	94.30
317	372	48	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	94.13	95.00	94.01	93.96	94.88	94.76	93.49	94.50	94.30	95.82	93.49	95.22	93.61	94.78	94.08	94.45	95.40	93.64	93.49	94.60	95.15	94.68	94.73	94.45	95.18	94.47
318	372	48	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	95.24	94.17	94.28	94.02	95.01	94.19	93.90	93.65	93.77	92.18	95.18	94.88	93.52	93.98	93.04	93.41	93.00	92.86	93.46	94.19	94.63	94.24	95.23	94.30	93.63	94.62
319	372	48	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	94.04	94.87	95.20	94.11	94.38	93.61	93.90	93.90	94.23	93.91	93.65	94.60	95.38	94.36	94.99	93.88	94.99	94.69	94.93	92.63	95.84	94.41	94.82	95.91	95.82	94.61
336	372	48	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	94.63	94.51	93.05	93.96	93.84	94.56	94.30	92.93	94.59	94.61	93.80	94.62	95.64	95.35	94.22	93.87	94.94	93.50	94.05	94.04	94.59	94.81	93.24	94.54	95.71	94.11
337	372	48	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	94.21	93.90	95.86	94.26	94.12	93.19	93.85	94.15	94.21	94.04	93.68	93.85	94.60	94.33	93.96	94.48	95.06	94.56	93.47	94.76	95.50	95.41	94.50	95.14	94.57	94.52
338	372	48	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	94.26	95.48	96.09	92.83	94.36	93.03	94.12	95.12	94.88	94.91	94.36	93.34	94.85	93.76	94.41	93.52	93.63	93.82	94.15	94.72	95.25	94.30	94.71	95.04	96.05	92.84
339	372	48	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	94.72	94.91	96.05	94.73	95.19	94.37	94.17	92.69	94.96	93.99	94.84	95.33	94.36	93.99	94.48	93.90	94.81	94.29	95.43	94.75	94.47	93.93	94.15	93.62	95.04	95.21
356	372	48	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	94.37	94.53	95.04	94.16	94.20	94.02	94.08	93.97	93.24	94.43	93.84	94.02	94.33	94.73	92.87	94.13	95.13	94.14	94.93	93.64	94.21	94.91	95.28	94.42	94.48	94.75
357	372	48	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	95.55	94.89	95.05	93.77	93.18	93.47	94.47	94.54	94.51	94.89	94.17	94.60	95.30	94.12	93.65	93.17	94.84	93.89	94.66	93.57	95.78	94.80	94.10	94.91	94.16	93.30
358	372	48	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	94.82	94.45	95.21	94.61	94.23	92.49	93.94	94.16	93.89	94.08	94.35	93.34	94.76	93.92	93.20	94.86	94.45	93.38	94.12	93.41	94.21	95.34	94.98	93.30	95.67	93.43
359	372	48	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	93.81	94.36	94.22	93.55	95.31	93.43	93.98	95.55	95.76	93.58	93.69	94.85	93.85	94.78	93.89	94.88	93.89	94.34	94.08	94.04	95.00	94.68	95.45	93.91	94.59	93.33
376	372	48	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.88	93.16	93.67	92.62	93.22	92.33	92.97	92.93	93.43	93.19	92.70	92.31	93.15	93.36	93.34	93.27	93.19	93.38	93.42	92.78	93.13	94.44	94.53	92.56	93.32	91.76
377	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	94.06	93.03	93.30	92.86	93.31	92.88	92.83	92.86	91.59	93.92	92.54	91.47	92.51	93.39	92.33	92.96	93.40	92.47	92.81	92.50	93.42	93.61	95.56	91.67	93.46	92.30
378	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.76	93.27	92.86	93.09	92.70	94.10	91.45	91.13	92.31	91.78	93.68	92.65	92.64	92.39	93.03	93.95	92.86	93.62	93.42	92.85	93.75	92.80	91.64	92.11	93.76	91.69
379	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.87	94.33	91.34	92.61	93.86	92.95	92.20	92.89	92.28	92.73	93.85	93.11	91.42	92.42	91.80	92.19	93.25	92.50	93.27	93.92	93.56	92.54	93.29	93.30	92.06	89.74
396	372	48	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.22	92.26	92.50	93.24	92.97	93.16	91.90	90.87	91.27	92.65	90.73	91.53	92.04	94.14	93.65	93.23	92.58	93.87	93.62	91.58	92.47	93.89	92.93	91.12	91.56	92.03
397	372	48	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	92.87	93.32	92.63	92.88	93.70	92.33	92.58	92.28	92.50	93.52	91.78	91.38	92.42	92.96	92.28	93.27	92.17	93.05	92.52	92.71	95.09	93.37	94.68	91.69	92.21	91.33
398	372	48	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	91.67	93.55	91.61	93.15	93.36	92.54	92.39	92.04	90.89	92.46	93.66	91.48	92.68	92.75	91.83	93.47	92.62	92.36	94.05	93.37	92.71	92.42	91.83	92.60	92.79	89.94
399	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	94.12	92.66	94.36	93.23	93.44	91.95	93.35	92.16	93.10	93.39	93.76	93.82	92.62	92.80	93.10	92.14	93.48	94.15	92.49	93.53	93.89	93.16	90.82	93.22	92.94	92.53
416	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	92.71	92.79	93.85	93.45	93.01	93.41	93.25	92.63	93.10	93.05	92.78	92.36	90.83	92.96	92.00	93.90	93.10	93.41	91.97	93.70	94.36	94.81	92.75	92.27	93.52	91.84
417	372	48	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	92.87	93.40	94.74	93.57	93.59	92.89	92.48	93.85	92.34	92.19	94.21	91.23	91.74	93.64	92.39	92.71	92.42	94.10	93.32	92.62	93.46	93.42	94.44	93.22	93.88	93.06
418	372	48	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	92.57	93.99	93.83	93.67	93.87	93.14	92.56	91.90	92.92	93.21	93.64	92.02	91.88	93.55	92.20	93.27	92.21	93.72	94.26	92.35	94.16	94.77	92.23	90.52	92.52	91.09
419	372	48	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	93.71	92.78	94.50	92.04	92.96	91.80	92.90	93.19	93.09	93.21	93.56	92.38	92.70	93.47	92.88	93.92	92.75	94.57	92.13	93.83	92.98	94.62	91.77	93.19	93.27	93.49
436	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	93.34	92.04	92.48	92.99	93.43	93.38	92.89	91.90	92.11	93.23	92.46	93.23	93.54	92.79	92.48	92.74	93.79	93.73	93.19	92.15	93.24	92.94	93.41	92.79	91.18	92.32
437	372	48	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	91.18	93.65	92.93	93.82	93.79	91.92	92.82	93.78	92.28	92.23	92.72	93.42	91.06	93.34	91.12	92.28	91.67	92.87	92.48	92.61	94.68	93.87	93.49	91.22	91.69	92.44
438	372	48	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	92.72	94.31	94.34	92.00	93.13	92.80	92.83	93.20	92.10	93.18	92.78	92.08	92.30	92.31	91.64	92.85	92.66	93.51	92.77	93.57	93.36	93.58	93.84	92.15	93.13	92.03
439	372	48	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	92.16	94.04	93.30	92.89	92.04	92.39	92.39	92.27	91.47	92.30	92.57	92.04	92.24	93.63	91.61	93.07	92.80	92.40	92.85	93.42	92.50	92.89	93.83	92.32	93.23	92.61
456	372	48	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	92.24	93.91	93.19	91.95	92.61	92.90	91.78	92.23	92.31	93.37	93.04	93.13	92.24	93.26	92.24	94.03	92.72	93.10	93.19	93.19	92.77	93.76	93.44	91.89	93.33	91.50
457	372	48	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	92.07	93.08	93.35	92.77	92.55	92.41	93.32	92.63	91.60	92.58	94.10	91.80	92.92	93.46	92.44	92.92	93.24	94.44	92.93	92.87	92.93	93.55	94.56	93.03	92.81	92.91
458	372	48	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	92.66	93.47	93.43	92.41	92.08	92.05	92.07	92.73	91.74	91.05	93.10	92.95	92.38	93.54	91.63	92.73	92.45	92.15	93.16	91.80	92.07	93.70	92.82	92.52	92.92	93.05
459	372	48	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	92.86	93.48	92.90	93.14	93.91	92.78	92.56	93.74	92.49	92.56	91.86	92.99	92.37	93.51	92.84	93.37	93.76	93.28	93.35	93.08	93.71	92.88	92.64	91.74	91.90	91.73
476	372	48	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	94.59	94.05	93.71	93.51	93.29	92.91	92.07	93.25	93.00	92.31	93.51	93.33	92.62	93.27	92.69	92.22	92.93	92.62	93.48	92.05	93.91	93.62	93.58	92.13	92.72	92.26
477	372	48	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	93.56	93.23	93.06	91.48	93.45	93.52	92.75	93.79	93.35	93.02	92.76	92.34	91.99	93.55	91.19	93.20	92.75	92.86	93.57	93.71	92.84	93.17	94.15	90.54	93.60	91.58
478	372	48	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	92.52	93.44	94.35	91.48	93.51	92.45	93.00	93.08	93.22	93.73	92.88	93.47	92.14	94.06	92.78	93.26	93.13	92.48	93.42	93.99	93.20	93.56	93.05	92.67	93.41	92.03
479	372	48	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	94.06	94.06	93.18	92.62	93.23	93.08	91.67	92.84	92.40	91.30	92.70	92.22	91.60	93.98	92.77	92.34	92.70	93.61	94.12	92.28	93.66	93.14	94.14	92.44	95.13	91.72
496	372	48	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	91.48	93.25	91.01	93.62	93.12	92.53	93.08	91.93	93.18	92.54	91.84	92.57	92.98	93.15	92.57	92.47	93.36	93.48	91.94	93.93	92.97	92.34	91.65	91.58	91.58	91.73
497	372	48	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	91.20	92.46	92.61	92.82	93.42	91.79	92.71	92.49	91.62	91.87	93.09	92.03	92.60	93.49	92.70	94.42	92.56	92.59	93.19	92.61	93.78	94.09	93.19	92.41	92.42	92.34
498	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	89.81	92.88	92.63	91.81	92.51	93.20	90.97	91.92	90.86	91.83	92.96	93.71	93.21	92.71	93.43	92.06	92.65	91.45	93.10	92.22	93.16	92.05	92.55	94.07	93.21	91.81
499	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.70	93.28	92.54	92.35	93.27	92.11	93.23	91.32	92.20	92.21	92.90	92.10	93.11	94.07	91.97	93.41	94.31	93.89	92.78	93.36	92.09	91.71	90.77	93.52	91.59	90.22
516	372	48	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	91.91	92.95	93.84	93.75	92.79	93.02	92.59	92.42	91.01	92.34	92.76	91.88	92.79	93.66	92.34	93.16	93.85	94.24	93.50	93.28	94.43	93.19	92.85	92.95	91.98	93.41
517	372	48	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	92.86	92.47	92.87	92.55	92.20	92.38	93.21	92.13	92.49	92.92	92.05	92.16	92.62	93.11	93.58	92.99	93.87	93.11	90.75	93.11	92.69	94.22	92.78	93.06	92.86	90.29
518	372	48	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	92.30	92.79	94.55	92.92	93.95	92.66	91.72	92.73	91.94	94.01	93.12	92.82	90.77	93.35	91.82	93.26	92.24	93.27	92.97	91.29	91.28	92.98	92.77	92.21	92.93	92.04
519	372	48	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	93.22	92.88	93.21	92.78	93.66	93.31	92.28	92.68	92.33	91.83	93.04	90.18	93.07	93.66	92.89	93.00	93.20	92.31	93.42	92.20	93.56	92.55	92.88	90.98	91.10	92.53
536	372	48	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	92.40	92.85	94.03	92.90	94.80	92.58	92.41	93.35	93.44	93.36	93.44	92.14	92.73	93.30	92.68	93.51	93.25	92.53	94.00	92.79	94.07	94.33	93.27	91.82	92.87	91.39
537	372	48	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	92.38	92.22	93.31	92.26	91.51	90.66	92.98	93.84	91.89	93.30	92.90	91.54	92.83	91.70	90.82	92.18	93.42	93.79	93.02	90.39	93.50	92.80	93.58	92.43	93.46	91.48
538	372	48	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	92.87	93.23	92.21	93.01	93.01	93.04	93.34	92.27	93.89	92.79	93.15	92.11	93.26	92.18	92.94	93.53	93.16	94.38	93.78	91.90	94.59	93.66	92.80	92.37	93.29	91.14
539	372	48	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	93.90	93.55	93.79	93.44	92.98	94.18	92.14	92.80	93.02	92.34	93.72	92.39	91.53	92.55	92.95	94.26	93.13	92.02	94.89	92.52	93.77	93.93	93.78	93.51	92.75	92.55
556	372	48	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	92.53	92.73	93.53	92.37	92.89	92.77	92.35	93.07	92.29	91.77	92.83	90.44	92.99	92.71	92.41	93.49	93.08	92.91	92.84	91.53	91.85	92.82	92.45	93.04	91.98	92.01
557	372	48	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	93.18	92.70	93.43	94.63	93.58	91.84	92.50	92.43	92.18	92.22	92.33	91.88	93.36	93.75	92.34	93.20	93.11	91.63	92.93	91.84	94.36	93.32	94.03	92.33	92.85	92.25
558	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	93.33	93.03	93.82	93.62	92.96	92.17	92.66	92.43	91.69	92.99	92.75	92.20	93.16	93.10	92.19	92.92	92.78	91.50	92.74	92.77	93.49	90.10	92.92	91.99	92.61	90.62
559	372	48	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	92.18	93.06	92.83	93.29	93.17	93.09	93.20	92.51	91.59	91.58	92.51	92.60	92.97	93.94	92.62	93.69	91.85	93.86	94.35	92.73	94.58	94.92	93.37	92.19	92.14	91.99
576	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	93.26	93.92	92.96	93.47	94.30	91.66	92.92	92.71	92.63	92.33	92.48	93.80	91.47	93.82	92.17	93.05	93.07	93.07	93.26	93.08	92.90	93.05	93.92	93.34	92.59	92.03
577	372	48	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	92.92	92.59	94.01	92.44	92.84	93.64	90.82	93.23	92.64	92.16	92.95	93.61	91.07	92.62	92.25	92.49	92.99	93.33	93.60	94.34	93.28	92.93	94.23	93.00	92.94	90.69
578	372	48	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	93.23	93.88	93.00	92.50	92.91	92.37	91.02	91.79	91.73	92.11	92.60	91.09	92.36	91.96	94.23	92.26	92.60	92.60	93.37	92.68	94.43	94.24	93.95	91.34	92.91	91.74
579	372	48	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	92.89	94.54	92.85	94.24	92.34	91.63	93.03	91.86	93.07	91.55	92.04	92.05	91.17	92.97	91.71	93.12	92.17	93.54	92.41	92.56	92.85	93.76	94.38	93.44	91.85	92.14
596	372	48	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	93.69	92.18	92.69	92.26	93.30	92.90	92.50	92.22	91.58	92.81	93.05	93.21	93.14	94.07	91.59	92.98	92.79	93.37	93.08	93.00	92.75	93.76	93.41	92.96	92.46	91.27
597	372	48	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	92.06	93.15	93.38	92.05	93.23	93.14	93.53	93.23	92.72	92.79	93.43	92.41	90.84	93.54	92.49	92.32	93.99	92.78	93.58	92.42	94.26	91.06	93.83	91.52	94.11	91.59
598	372	48	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	93.93	93.49	93.47	92.57	92.78	92.82	92.47	92.65	92.17	94.22	93.23	91.39	92.73	91.50	92.06	92.64	92.09	92.72	94.53	94.06	92.49	92.79	93.65	94.14	91.81	91.88
599	372	48	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	93.17	94.02	92.77	93.02	92.62	92.10	91.96	93.18	92.16	92.66	93.11	93.83	92.61	93.19	92.47	93.16	93.48	93.23	93.11	93.59	93.44	92.71	92.73	92.69	91.11	91.93
616	372	48	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	92.55	92.26	93.39	92.86	91.80	92.86	92.73	93.28	91.53	93.54	92.87	91.21	91.99	93.61	91.13	93.26	92.55	92.94	93.88	91.89	92.52	92.33	94.07	94.28	93.47	91.50
617	372	48	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	92.83	93.76	92.95	93.59	93.82	93.37	92.64	91.15	92.07	93.52	92.70	92.11	92.15	93.00	91.27	94.54	93.08	93.15	92.80	92.44	92.97	93.31	93.89	92.16	93.35	91.59
618	372	48	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	93.43	92.90	93.08	93.04	92.78	92.00	91.20	92.31	92.34	92.85	93.63	91.54	92.91	92.82	91.83	93.07	92.64	93.17	93.39	92.57	93.62	94.22	92.94	94.14	92.41	93.49
619	372	48	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	93.18	92.95	91.77	93.76	91.46	93.85	93.02	93.61	93.49	93.15	91.81	93.03	92.24	92.35	93.53	92.74	93.26	92.33	93.28	91.88	92.48	92.36	93.48	92.06	92.82	92.52
636	372	48	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	92.26	93.05	93.25	90.77	92.24	93.37	92.94	92.89	91.92	92.87	93.10	91.93	93.40	94.11	92.95	93.17	93.40	93.29	93.43	92.82	93.62	93.52	92.81	91.52	93.91	91.68
637	372	48	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	91.93	93.43	92.82	93.06	93.44	91.48	92.52	92.51	91.63	92.82	93.40	93.08	92.04	93.54	91.90	92.32	93.73	92.68	94.03	93.58	93.01	90.73	93.81	91.97	93.51	91.27
638	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	93.43	92.96	92.50	93.04	93.91	93.28	92.82	93.11	92.87	93.75	92.27	92.29	94.16	93.11	92.84	94.12	93.24	94.63	94.15	92.79	93.47	92.91	93.56	93.45	91.06	92.39
639	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	91.34	92.80	93.97	92.37	92.84	93.00	92.83	92.21	93.13	92.74	93.31	93.02	90.48	92.37	92.26	93.65	93.97	92.16	93.26	92.33	92.86	93.17	93.79	92.54	92.80	92.08
656	372	48	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	93.20	93.13	92.93	93.99	93.05	91.48	92.67	92.14	93.28	92.71	92.39	93.75	92.75	93.89	93.54	93.65	93.17	92.80	94.44	93.54	94.55	94.23	91.73	93.35	93.82	93.19
657	372	48	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	91.71	93.13	93.49	93.09	92.42	93.73	92.61	91.12	92.20	92.24	93.98	92.45	93.05	92.37	93.44	93.63	94.05	93.15	94.19	93.47	91.77	92.56	92.47	92.74	94.04	91.68
658	372	48	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	94.01	92.80	93.00	92.42	92.82	94.11	92.88	93.18	92.79	92.53	92.60	91.67	94.25	93.19	92.65	92.86	93.96	93.73	92.84	92.52	92.86	93.42	93.30	92.37	93.67	92.64
659	372	48	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	93.32	92.35	93.98	93.76	93.87	93.21	93.09	93.41	92.35	92.79	94.02	92.05	91.03	94.28	93.46	92.87	94.19	93.86	92.49	92.80	94.72	94.35	94.11	91.26	92.46	93.23
676	372	48	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	91.11	92.11	91.88	92.30	90.81	93.03	90.47	92.20	91.81	91.89	93.07	91.85	91.82	92.85	93.85	93.56	93.08	92.38	92.67	93.42	92.78	91.84	92.66	90.88	91.91	90.70
677	372	48	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	92.40	93.75	92.12	92.12	92.32	92.47	91.16	93.77	91.72	92.36	93.12	91.97	92.59	92.84	91.90	92.71	92.30	93.70	93.78	91.24	92.48	92.71	92.18	92.59	92.61	91.65
678	372	48	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	92.14	93.20	92.51	92.76	92.35	93.44	92.02	92.94	92.96	92.93	92.35	91.73	92.80	93.60	92.92	94.24	93.26	94.25	93.36	93.57	92.53	92.56	93.00	93.15	92.16	91.37
679	372	48	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	92.15	93.29	93.41	92.57	92.74	92.63	94.02	92.98	90.19	93.12	92.89	92.32	91.89	93.87	92.14	93.39	92.83	93.49	94.24	93.65	93.74	91.87	92.08	92.75	92.54	92.34

Model performance on validation data (T-test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues = []
pvalues_real = []

for _,index in enumerate(dt_valid_sub.index):
  _, p_value = stats.ttest_ind(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')
  pvalues_real.append(p_value)
  pvalues.append((p_value >= 0.05)*1)

  

dt_valid_sub['pvalues'] = pvalues_real
dt_valid_sub['sig'] = pvalues


dt_valid_sub1 = dt_valid_sub.query('sig == 1')


max_indexx = dt_valid_sub1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
556	372	48	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	89.91	91.75	91.41	91.07	91.21	90.74	91.17	91.16	90.73	89.59	90.73	90.40	92.42	90.44	91.55	90.59	90.63	91.27	91.28	91.87	90.83	90.76	90.71	90.85	90.90	89.04
558	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	90.71	92.08	92.17	92.21	91.20	90.43	89.63	89.96	91.62	90.42	90.92	91.94	92.41	90.97	90.85	91.38	91.34	89.88	90.61	92.06	91.08	90.65	90.92	89.77	90.10	90.17
676	372	48	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	91.05	89.86	90.50	91.01	91.40	90.89	90.68	90.21	91.55	91.80	90.78	90.69	92.45	90.49	90.19	90.96	92.21	92.13	91.27	91.83	90.82	90.48	90.03	89.36	90.12	90.05
376	372	48	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.44	90.75	90.40	92.35	92.51	89.96	90.55	90.05	91.11	90.17	89.63	91.24	92.20	90.89	91.12	91.64	90.84	92.22	91.99	90.94	89.86	90.14	90.06	88.56	90.89	88.86
377	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	91.56	91.91	92.04	90.64	91.37	90.23	91.76	91.36	91.08	91.14	91.77	91.13	90.26	91.77	91.49	92.25	91.87	92.43	90.16	91.44	90.50	90.61	91.21	89.60	91.15	89.77
378	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	91.40	91.50	91.35	90.69	91.50	90.42	91.63	91.32	91.18	91.40	91.41	90.54	91.13	91.94	91.41	91.91	91.47	93.03	90.51	90.92	90.00	89.79	90.45	88.95	91.19	89.22
379	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.62	92.56	90.84	91.64	91.29	91.09	90.15	90.39	92.35	90.29	90.57	91.55	91.77	90.61	90.50	91.57	91.49	91.53	90.13	91.21	89.95	91.26	90.45	90.03	91.04	88.95
436	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	91.23	89.28	90.61	91.42	91.50	90.84	91.26	90.78	89.33	91.48	91.74	91.55	91.03	91.50	90.86	91.82	92.57	92.11	91.25	91.02	90.18	90.32	90.39	90.70	89.09	90.08
498	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	89.72	91.62	90.05	92.19	91.31	89.95	91.03	90.20	89.94	91.39	90.29	91.01	92.07	90.40	92.11	92.29	92.21	90.49	92.14	91.27	90.98	89.58	90.76	89.46	90.76	90.53
499	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.28	90.54	91.48	92.55	91.48	91.36	90.22	90.64	91.86	91.29	90.60	91.21	90.55	91.29	92.03	90.48	91.76	91.38	91.56	91.55	91.08	89.55	90.00	90.83	90.26	89.87
576	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	89.95	91.53	90.64	91.69	92.02	89.86	91.11	90.61	89.22	89.63	90.44	91.46	91.48	91.54	90.87	92.20	91.88	91.28	91.70	89.57	91.69	90.25	89.59	90.89	90.15	90.92
638	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	90.73	91.68	90.32	90.66	91.62	91.43	89.78	91.51	90.66	90.35	90.70	91.29	91.52	90.67	90.80	91.76	91.89	91.83	91.81	90.11	91.00	90.94	90.01	90.76	91.14	90.84
639	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	89.24	90.84	90.40	91.13	91.27	92.25	90.78	90.94	91.54	90.71	91.04	92.05	91.51	89.95	91.22	92.32	92.12	89.35	91.63	91.76	90.10	91.31	90.76	89.94	90.28	90.18
397	372	48	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	90.63	91.87	90.09	92.15	90.67	89.76	90.73	91.59	90.51	90.30	90.29	91.01	91.36	91.11	91.40	92.11	91.40	92.15	90.72	91.74	90.42	89.21	90.26	88.96	90.82	89.95
399	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	92.31	92.28	90.60	92.56	91.88	91.07	90.66	90.36	90.78	89.62	91.45	90.65	89.87	90.26	90.83	91.70	92.19	90.37	90.12	90.71	91.05	90.79	88.88	90.34	90.69	90.63
597	372	48	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	90.16	90.97	90.39	92.00	89.89	91.65	89.81	90.33	90.26	90.95	91.01	91.81	91.23	90.40	92.14	91.47	91.66	90.93	91.31	90.66	91.01	90.84	90.55	89.66	91.83	90.12
416	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	91.50	91.39	92.55	90.52	90.72	90.77	90.73	91.28	89.40	89.14	90.92	91.14	89.97	92.23	90.77	91.95	91.41	91.77	89.91	92.03	91.51	90.87	88.07	89.16	89.84	90.62

Size of the All data:  (136, 29)
Size of the Sig data:  (17, 29)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params1 = dt_valid.loc[dt_valid_sub1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params = optimal_params1.reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
10	372	48	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	92.53	92.73	93.53	92.37	92.89	92.77	92.35	93.07	92.29	91.77	92.83	90.44	92.99	92.71	92.41	93.49	93.08	92.91	92.84	91.53	91.85	92.82	92.45	93.04	91.98	92.01
4	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	93.33	93.03	93.82	93.62	92.96	92.17	92.66	92.43	91.69	92.99	92.75	92.20	93.16	93.10	92.19	92.92	92.78	91.50	92.74	92.77	93.49	90.10	92.92	91.99	92.61	90.62
11	372	48	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	91.11	92.11	91.88	92.30	90.81	93.03	90.47	92.20	91.81	91.89	93.07	91.85	91.82	92.85	93.85	93.56	93.08	92.38	92.67	93.42	92.78	91.84	92.66	90.88	91.91	90.70
15	372	48	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.88	93.16	93.67	92.62	93.22	92.33	92.97	92.93	93.43	93.19	92.70	92.31	93.15	93.36	93.34	93.27	93.19	93.38	93.42	92.78	93.13	94.44	94.53	92.56	93.32	91.76
0	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	94.06	93.03	93.30	92.86	93.31	92.88	92.83	92.86	91.59	93.92	92.54	91.47	92.51	93.39	92.33	92.96	93.40	92.47	92.81	92.50	93.42	93.61	95.56	91.67	93.46	92.30
1	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.76	93.27	92.86	93.09	92.70	94.10	91.45	91.13	92.31	91.78	93.68	92.65	92.64	92.39	93.03	93.95	92.86	93.62	93.42	92.85	93.75	92.80	91.64	92.11	93.76	91.69
7	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.87	94.33	91.34	92.61	93.86	92.95	92.20	92.89	92.28	92.73	93.85	93.11	91.42	92.42	91.80	92.19	93.25	92.50	93.27	93.92	93.56	92.54	93.29	93.30	92.06	89.74
6	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	93.34	92.04	92.48	92.99	93.43	93.38	92.89	91.90	92.11	93.23	92.46	93.23	93.54	92.79	92.48	92.74	93.79	93.73	93.19	92.15	93.24	92.94	93.41	92.79	91.18	92.32
8	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	89.81	92.88	92.63	91.81	92.51	93.20	90.97	91.92	90.86	91.83	92.96	93.71	93.21	92.71	93.43	92.06	92.65	91.45	93.10	92.22	93.16	92.05	92.55	94.07	93.21	91.81
3	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.70	93.28	92.54	92.35	93.27	92.11	93.23	91.32	92.20	92.21	92.90	92.10	93.11	94.07	91.97	93.41	94.31	93.89	92.78	93.36	92.09	91.71	90.77	93.52	91.59	90.22
13	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	93.26	93.92	92.96	93.47	94.30	91.66	92.92	92.71	92.63	92.33	92.48	93.80	91.47	93.82	92.17	93.05	93.07	93.07	93.26	93.08	92.90	93.05	93.92	93.34	92.59	92.03
2	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	93.43	92.96	92.50	93.04	93.91	93.28	92.82	93.11	92.87	93.75	92.27	92.29	94.16	93.11	92.84	94.12	93.24	94.63	94.15	92.79	93.47	92.91	93.56	93.45	91.06	92.39
5	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	91.34	92.80	93.97	92.37	92.84	93.00	92.83	92.21	93.13	92.74	93.31	93.02	90.48	92.37	92.26	93.65	93.97	92.16	93.26	92.33	92.86	93.17	93.79	92.54	92.80	92.08
14	372	48	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	92.87	93.32	92.63	92.88	93.70	92.33	92.58	92.28	92.50	93.52	91.78	91.38	92.42	92.96	92.28	93.27	92.17	93.05	92.52	92.71	95.09	93.37	94.68	91.69	92.21	91.33
12	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	94.12	92.66	94.36	93.23	93.44	91.95	93.35	92.16	93.10	93.39	93.76	93.82	92.62	92.80	93.10	92.14	93.48	94.15	92.49	93.53	93.89	93.16	90.82	93.22	92.94	92.53
9	372	48	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	92.06	93.15	93.38	92.05	93.23	93.14	93.53	93.23	92.72	92.79	93.43	92.41	90.84	93.54	92.49	92.32	93.99	92.78	93.58	92.42	94.26	91.06	93.83	91.52	94.11	91.59
16	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	92.71	92.79	93.85	93.45	93.01	93.41	93.25	92.63	93.10	93.05	92.78	92.36	90.83	92.96	92.00	93.90	93.10	93.41	91.97	93.70	94.36	94.81	92.75	92.27	93.52	91.84

Size of the test data:  (17, 34)

Difference

diff = dt[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt.columns,test_data_1.columns)):   
   diff[f'col_diff_{i}'] = (np.array(dt[cols[0]]) - np.array(test_data_1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff['negative_count'] = diff.apply(count_negatives, axis=1)
diff.sort_values(by =["negative_count"],inplace = True, ascending=False)

html_table = diff.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

# 
# show(diff)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
498	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.09	1.26	2.58	-0.38	1.20	3.25	-0.06	1.72	0.92	0.44	2.67	2.70	1.14	2.31	1.32	-0.23	0.44	0.96	0.96	0.95	2.18	2.47	1.79	4.61	2.45	1.28	3
676	372	48	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.06	2.25	1.38	1.29	-0.59	2.14	-0.21	1.99	0.26	0.09	2.29	1.16	-0.63	2.36	3.66	2.60	0.87	0.25	1.40	1.59	1.96	1.36	2.63	1.52	1.79	0.65	3
499	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.42	2.74	1.06	-0.20	1.79	0.75	3.01	0.68	0.34	0.92	2.30	0.89	2.56	2.78	-0.06	2.93	2.55	2.51	1.22	1.81	1.01	2.16	0.77	2.69	1.33	0.35	2
378	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.36	1.77	1.51	2.40	1.20	3.68	-0.18	-0.19	1.13	0.38	2.27	2.11	1.51	0.45	1.62	2.04	1.39	0.59	2.91	1.93	3.75	3.01	1.19	3.16	2.57	2.47	2
379	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.25	1.77	0.50	0.97	2.57	1.86	2.05	2.50	-0.07	2.44	3.28	1.56	-0.35	1.81	1.30	0.62	1.76	0.97	3.14	2.71	3.61	1.28	2.84	3.27	1.02	0.79	2
597	372	48	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.90	2.18	2.99	0.05	3.34	1.49	3.72	2.90	2.46	1.84	2.42	0.60	-0.39	3.14	0.35	0.85	2.33	1.85	2.27	1.76	3.25	0.22	3.28	1.86	2.28	1.47	1
639	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.10	1.96	3.57	1.24	1.57	0.75	2.05	1.27	1.59	2.03	2.27	0.97	-1.03	2.42	1.04	1.33	1.85	2.81	1.63	0.57	2.76	1.86	3.03	2.60	2.52	1.90	1
638	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.70	1.28	2.18	2.38	2.29	1.85	3.04	1.60	2.21	3.40	1.57	1.00	2.64	2.44	2.04	2.36	1.35	2.80	2.34	2.68	2.47	1.97	3.55	2.69	-0.08	1.55	1
576	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.31	2.39	2.32	1.78	2.28	1.80	1.81	2.10	3.41	2.70	2.04	2.34	-0.01	2.28	1.30	0.85	1.19	1.79	1.56	3.51	1.21	2.80	4.33	2.45	2.44	1.11	1
556	372	48	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.62	0.98	2.12	1.30	1.68	2.03	1.18	1.91	1.56	2.18	2.10	0.04	0.57	2.27	0.86	2.90	2.45	1.64	1.56	-0.34	1.02	2.06	1.74	2.19	1.08	2.97	1
558	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.62	0.95	1.65	1.41	1.76	1.74	3.03	2.47	0.07	2.57	1.83	0.26	0.75	2.13	1.34	1.54	1.44	1.62	2.13	0.71	2.41	-0.55	2.00	2.22	2.51	0.45	1
436	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.11	2.76	1.87	1.57	1.93	2.54	1.63	1.12	2.78	1.75	0.72	1.68	2.51	1.29	1.62	0.92	1.22	1.62	1.94	1.13	3.06	2.62	3.02	2.09	2.09	2.24	0
377	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.50	1.12	1.26	2.22	1.94	2.65	1.07	1.50	0.51	2.78	0.77	0.34	2.25	1.62	0.84	0.71	1.53	0.04	2.65	1.06	2.92	3.00	4.35	2.07	2.31	2.53	0
397	372	48	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.24	1.45	2.54	0.73	3.03	2.57	1.85	0.69	1.99	3.22	1.49	0.37	1.06	1.85	0.88	1.16	0.77	0.90	1.80	0.97	4.67	4.16	4.42	2.73	1.39	1.38	0
399	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.81	0.38	3.76	0.67	1.56	0.88	2.69	1.80	2.32	3.77	2.31	3.17	2.75	2.54	2.27	0.44	1.29	3.78	2.37	2.82	2.84	2.37	1.94	2.88	2.25	1.90	0
376	372	48	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.44	2.41	3.27	0.27	0.71	2.37	2.42	2.88	2.32	3.02	3.07	1.07	0.95	2.47	2.22	1.63	2.35	1.16	1.43	1.84	3.27	4.30	4.47	4.00	2.43	2.90	0
416	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.21	1.40	1.30	2.93	2.29	2.64	2.52	1.35	3.70	3.91	1.86	1.22	0.86	0.73	1.23	1.95	1.69	1.64	2.06	1.67	2.85	3.94	4.68	3.11	3.68	1.22	0

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_17	91.702353	0.505056
mAP_valid_abs_values_16	91.670588	0.559402
mAP_valid_abs_values_4	91.557647	0.717221
mAP_valid_abs_values_18	91.420588	0.967461
mAP_valid_abs_values_13	91.366471	0.831068
mAP_valid_abs_values_5	91.343529	0.573203
mAP_valid_abs_values_2	91.318235	0.857053
mAP_valid_abs_values_20	91.217059	0.689871
mAP_valid_abs_values_12	91.215882	0.479532
mAP_valid_abs_values_15	91.184706	0.560860
mAP_valid_abs_values_19	91.064706	0.718967
mAP_valid_abs_values_14	90.968235	0.653254
mAP_valid_abs_values_3	90.931765	0.762285
mAP_valid_abs_values_11	90.840588	0.550482
mAP_valid_abs_values_9	90.771765	0.914175
mAP_valid_abs_values_6	90.747059	0.691852
mAP_valid_abs_values_8	90.746471	0.539907
mAP_valid_abs_values	90.731765	0.796651
mAP_valid_abs_values_21	90.709412	0.550494
mAP_valid_abs_values_7	90.687059	0.619786
mAP_valid_abs_values_25	90.602941	0.645337
mAP_valid_abs_values_10	90.568824	0.785938
mAP_valid_abs_values_22	90.432353	0.608805
mAP_valid_abs_values_23	90.182353	0.769891
mAP_valid_abs_values_26	89.988235	0.647150
mAP_valid_abs_values_24	89.871765	0.754348

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_21	93.370588	0.794705
mAP_test_abs_values_17	93.259412	0.534491
mAP_test_abs_values_5	93.140588	0.759362
mAP_test_abs_values_23	93.125294	1.285487
mAP_test_abs_values_16	93.117647	0.653907
mAP_test_abs_values_3	93.041176	0.796782
mAP_test_abs_values_19	93.027647	0.505650
mAP_test_abs_values_2	93.027059	0.553893
mAP_test_abs_values_14	93.020588	0.486627
mAP_test_abs_values_18	93.004706	0.878145
mAP_test_abs_values_11	92.914706	0.556834
mAP_test_abs_values_20	92.827059	0.622513
mAP_test_abs_values_6	92.805294	0.630656
mAP_test_abs_values_10	92.771176	0.702352
mAP_test_abs_values_4	92.771176	0.520563
average_map	92.764683	0.267104
mAP_test_abs_values_22	92.728235	1.146779
mAP_test_abs_values_25	92.606471	0.900333
mAP_test_abs_values_15	92.586471	0.580506
mAP_test_abs_values_24	92.585882	0.863214
mAP_test_abs_values_7	92.547059	0.844821
mAP_test_abs_values_12	92.479412	0.916055
mAP_test_abs_values_8	92.410588	0.608805
mAP_test_abs_values_9	92.389412	0.661282
mAP_test_abs_values_13	92.374706	1.057705
mAP_test_abs_values	92.363529	1.245406
mAP_test_abs_values_26	91.585882	0.807009

Model performance on validation data (Mann-Whitney U Test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues_mw = []
pvalues_real_mw = []

for _,index in enumerate(dt_valid_sub.index):

  _, p_value_mw = stats.mannwhitneyu(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')#, method = 'asymptotic')
  pvalues_real_mw.append(p_value_mw)
  pvalues_mw.append((p_value_mw >= 0.05)*1)
  

dt_valid_sub_mw['pvalues_mw'] = pvalues_real_mw
dt_valid_sub_mw['sig_mw'] = pvalues_mw

dt_valid_sub_mw1 = dt_valid_sub_mw.query('sig_mw == 1')


max_indexx = dt_valid_sub_mw1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
558	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	90.71	92.08	92.17	92.21	91.20	90.43	89.63	89.96	91.62	90.42	90.92	91.94	92.41	90.97	90.85	91.38	91.34	89.88	90.61	92.06	91.08	90.65	90.92	89.77	90.10	90.17
377	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	91.56	91.91	92.04	90.64	91.37	90.23	91.76	91.36	91.08	91.14	91.77	91.13	90.26	91.77	91.49	92.25	91.87	92.43	90.16	91.44	90.50	90.61	91.21	89.60	91.15	89.77
378	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	91.40	91.50	91.35	90.69	91.50	90.42	91.63	91.32	91.18	91.40	91.41	90.54	91.13	91.94	91.41	91.91	91.47	93.03	90.51	90.92	90.00	89.79	90.45	88.95	91.19	89.22
379	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.62	92.56	90.84	91.64	91.29	91.09	90.15	90.39	92.35	90.29	90.57	91.55	91.77	90.61	90.50	91.57	91.49	91.53	90.13	91.21	89.95	91.26	90.45	90.03	91.04	88.95
436	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	91.23	89.28	90.61	91.42	91.50	90.84	91.26	90.78	89.33	91.48	91.74	91.55	91.03	91.50	90.86	91.82	92.57	92.11	91.25	91.02	90.18	90.32	90.39	90.70	89.09	90.08
498	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	89.72	91.62	90.05	92.19	91.31	89.95	91.03	90.20	89.94	91.39	90.29	91.01	92.07	90.40	92.11	92.29	92.21	90.49	92.14	91.27	90.98	89.58	90.76	89.46	90.76	90.53
499	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.28	90.54	91.48	92.55	91.48	91.36	90.22	90.64	91.86	91.29	90.60	91.21	90.55	91.29	92.03	90.48	91.76	91.38	91.56	91.55	91.08	89.55	90.00	90.83	90.26	89.87
576	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	89.95	91.53	90.64	91.69	92.02	89.86	91.11	90.61	89.22	89.63	90.44	91.46	91.48	91.54	90.87	92.20	91.88	91.28	91.70	89.57	91.69	90.25	89.59	90.89	90.15	90.92
638	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	90.73	91.68	90.32	90.66	91.62	91.43	89.78	91.51	90.66	90.35	90.70	91.29	91.52	90.67	90.80	91.76	91.89	91.83	91.81	90.11	91.00	90.94	90.01	90.76	91.14	90.84
639	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	89.24	90.84	90.40	91.13	91.27	92.25	90.78	90.94	91.54	90.71	91.04	92.05	91.51	89.95	91.22	92.32	92.12	89.35	91.63	91.76	90.10	91.31	90.76	89.94	90.28	90.18
399	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	92.31	92.28	90.60	92.56	91.88	91.07	90.66	90.36	90.78	89.62	91.45	90.65	89.87	90.26	90.83	91.70	92.19	90.37	90.12	90.71	91.05	90.79	88.88	90.34	90.69	90.63
416	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	91.50	91.39	92.55	90.52	90.72	90.77	90.73	91.28	89.40	89.14	90.92	91.14	89.97	92.23	90.77	91.95	91.41	91.77	89.91	92.03	91.51	90.87	88.07	89.16	89.84	90.62

Size of the All data:  (136, 29)
Size of the Sig data:  (12, 34)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params_mw1 = dt_valid.loc[dt_valid_sub_mw1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params_mw = optimal_params_mw1.reset_index()
optimal_params_mw.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_mw1 = pd.merge(optimal_params_mw, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub_mw = test_data_mw1[list(test_data_mw1.columns[test_data_mw1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
4	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	93.33	93.03	93.82	93.62	92.96	92.17	92.66	92.43	91.69	92.99	92.75	92.20	93.16	93.10	92.19	92.92	92.78	91.50	92.74	92.77	93.49	90.10	92.92	91.99	92.61	90.62
0	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	94.06	93.03	93.30	92.86	93.31	92.88	92.83	92.86	91.59	93.92	92.54	91.47	92.51	93.39	92.33	92.96	93.40	92.47	92.81	92.50	93.42	93.61	95.56	91.67	93.46	92.30
1	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.76	93.27	92.86	93.09	92.70	94.10	91.45	91.13	92.31	91.78	93.68	92.65	92.64	92.39	93.03	93.95	92.86	93.62	93.42	92.85	93.75	92.80	91.64	92.11	93.76	91.69
7	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.87	94.33	91.34	92.61	93.86	92.95	92.20	92.89	92.28	92.73	93.85	93.11	91.42	92.42	91.80	92.19	93.25	92.50	93.27	93.92	93.56	92.54	93.29	93.30	92.06	89.74
6	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	93.34	92.04	92.48	92.99	93.43	93.38	92.89	91.90	92.11	93.23	92.46	93.23	93.54	92.79	92.48	92.74	93.79	93.73	93.19	92.15	93.24	92.94	93.41	92.79	91.18	92.32
8	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	89.81	92.88	92.63	91.81	92.51	93.20	90.97	91.92	90.86	91.83	92.96	93.71	93.21	92.71	93.43	92.06	92.65	91.45	93.10	92.22	93.16	92.05	92.55	94.07	93.21	91.81
3	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	90.70	93.28	92.54	92.35	93.27	92.11	93.23	91.32	92.20	92.21	92.90	92.10	93.11	94.07	91.97	93.41	94.31	93.89	92.78	93.36	92.09	91.71	90.77	93.52	91.59	90.22
10	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	93.26	93.92	92.96	93.47	94.30	91.66	92.92	92.71	92.63	92.33	92.48	93.80	91.47	93.82	92.17	93.05	93.07	93.07	93.26	93.08	92.90	93.05	93.92	93.34	92.59	92.03
2	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	93.43	92.96	92.50	93.04	93.91	93.28	92.82	93.11	92.87	93.75	92.27	92.29	94.16	93.11	92.84	94.12	93.24	94.63	94.15	92.79	93.47	92.91	93.56	93.45	91.06	92.39
5	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	91.34	92.80	93.97	92.37	92.84	93.00	92.83	92.21	93.13	92.74	93.31	93.02	90.48	92.37	92.26	93.65	93.97	92.16	93.26	92.33	92.86	93.17	93.79	92.54	92.80	92.08
9	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	94.12	92.66	94.36	93.23	93.44	91.95	93.35	92.16	93.10	93.39	93.76	93.82	92.62	92.80	93.10	92.14	93.48	94.15	92.49	93.53	93.89	93.16	90.82	93.22	92.94	92.53
11	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	92.71	92.79	93.85	93.45	93.01	93.41	93.25	92.63	93.10	93.05	92.78	92.36	90.83	92.96	92.00	93.90	93.10	93.41	91.97	93.70	94.36	94.81	92.75	92.27	93.52	91.84

Size of the test data:  (12, 34)

Difference

diff_mw = dt_mw[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt_mw.columns,test_data_mw1.columns)):   
   diff_mw[f'col_diff_{i}'] = (np.array(dt_mw[cols[0]]) - np.array(test_data_mw1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff_mw['negative_count'] = diff_mw.apply(count_negatives, axis=1)

diff_mw.sort_values(by =["negative_count"],inplace = True, ascending=False)


html_table = diff_mw.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

key_values = ['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']
print('Are the keys of the valid and test dfs same?: ',dt_mw[key_values].equals(test_data_mw1[key_values]))

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
498	372	48	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.09	1.26	2.58	-0.38	1.20	3.25	-0.06	1.72	0.92	0.44	2.67	2.70	1.14	2.31	1.32	-0.23	0.44	0.96	0.96	0.95	2.18	2.47	1.79	4.61	2.45	1.28	3
378	372	48	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.36	1.77	1.51	2.40	1.20	3.68	-0.18	-0.19	1.13	0.38	2.27	2.11	1.51	0.45	1.62	2.04	1.39	0.59	2.91	1.93	3.75	3.01	1.19	3.16	2.57	2.47	2
379	372	48	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.25	1.77	0.50	0.97	2.57	1.86	2.05	2.50	-0.07	2.44	3.28	1.56	-0.35	1.81	1.30	0.62	1.76	0.97	3.14	2.71	3.61	1.28	2.84	3.27	1.02	0.79	2
499	372	48	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.42	2.74	1.06	-0.20	1.79	0.75	3.01	0.68	0.34	0.92	2.30	0.89	2.56	2.78	-0.06	2.93	2.55	2.51	1.22	1.81	1.01	2.16	0.77	2.69	1.33	0.35	2
558	372	48	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.62	0.95	1.65	1.41	1.76	1.74	3.03	2.47	0.07	2.57	1.83	0.26	0.75	2.13	1.34	1.54	1.44	1.62	2.13	0.71	2.41	-0.55	2.00	2.22	2.51	0.45	1
576	372	48	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.31	2.39	2.32	1.78	2.28	1.80	1.81	2.10	3.41	2.70	2.04	2.34	-0.01	2.28	1.30	0.85	1.19	1.79	1.56	3.51	1.21	2.80	4.33	2.45	2.44	1.11	1
638	372	48	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.70	1.28	2.18	2.38	2.29	1.85	3.04	1.60	2.21	3.40	1.57	1.00	2.64	2.44	2.04	2.36	1.35	2.80	2.34	2.68	2.47	1.97	3.55	2.69	-0.08	1.55	1
639	372	48	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.10	1.96	3.57	1.24	1.57	0.75	2.05	1.27	1.59	2.03	2.27	0.97	-1.03	2.42	1.04	1.33	1.85	2.81	1.63	0.57	2.76	1.86	3.03	2.60	2.52	1.90	1
377	372	48	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.50	1.12	1.26	2.22	1.94	2.65	1.07	1.50	0.51	2.78	0.77	0.34	2.25	1.62	0.84	0.71	1.53	0.04	2.65	1.06	2.92	3.00	4.35	2.07	2.31	2.53	0
436	372	48	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.11	2.76	1.87	1.57	1.93	2.54	1.63	1.12	2.78	1.75	0.72	1.68	2.51	1.29	1.62	0.92	1.22	1.62	1.94	1.13	3.06	2.62	3.02	2.09	2.09	2.24	0
399	372	48	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.81	0.38	3.76	0.67	1.56	0.88	2.69	1.80	2.32	3.77	2.31	3.17	2.75	2.54	2.27	0.44	1.29	3.78	2.37	2.82	2.84	2.37	1.94	2.88	2.25	1.90	0
416	372	48	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.21	1.40	1.30	2.93	2.29	2.64	2.52	1.35	3.70	3.91	1.86	1.22	0.86	0.73	1.23	1.95	1.69	1.64	2.06	1.67	2.85	3.94	4.68	3.11	3.68	1.22	0

Are the keys of the valid and test dfs same?:  False

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_17	91.850000	0.378418
mAP_valid_abs_values_16	91.802500	0.512678
mAP_valid_abs_values_4	91.491667	0.766703
mAP_valid_abs_values_2	91.434167	0.880593
mAP_valid_abs_values_5	91.430000	0.332921
mAP_valid_abs_values_12	91.293333	0.454179
mAP_valid_abs_values_18	91.287500	1.079791
mAP_valid_abs_values_15	91.145000	0.515937
mAP_valid_abs_values_20	91.137500	0.743225
mAP_valid_abs_values_13	91.130833	0.819484
mAP_valid_abs_values_14	91.094167	0.724926
mAP_valid_abs_values_3	91.087500	0.814986
mAP_valid_abs_values_11	90.987500	0.502378
mAP_valid_abs_values_19	90.960833	0.798720
mAP_valid_abs_values_6	90.808333	0.686491
mAP_valid_abs_values_8	90.779167	0.506529
mAP_valid_abs_values	90.770833	0.880118
mAP_valid_abs_values_21	90.760000	0.595101
mAP_valid_abs_values_9	90.746667	1.057943
mAP_valid_abs_values_7	90.728333	0.681080
mAP_valid_abs_values_10	90.571667	0.799578
mAP_valid_abs_values_22	90.493333	0.605300
mAP_valid_abs_values_25	90.474167	0.640149
mAP_valid_abs_values_26	90.148333	0.617809
mAP_valid_abs_values_23	90.124167	0.903795
mAP_valid_abs_values_24	90.035833	0.671896

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params = dt_valid.loc[dt_valid_sub_mw1.index].iloc[:, :6].reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, how='left')
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]
test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_21	93.377917	0.665010
mAP_test_abs_values_2	93.225625	0.570248
mAP_test_abs_values_23	93.220625	1.212892
mAP_test_abs_values_5	93.188542	0.498508
mAP_test_abs_values_19	93.159792	0.593728
mAP_test_abs_values_14	93.145625	0.576338
mAP_test_abs_values_22	93.126875	1.057738
mAP_test_abs_values_16	93.112917	0.659174
mAP_test_abs_values_18	93.092292	0.805793
mAP_test_abs_values_17	93.050833	0.573937
mAP_test_abs_values_3	92.993125	0.883210
mAP_test_abs_values_20	92.925000	0.649645
mAP_test_abs_values_11	92.899792	0.667394
mAP_test_abs_values_4	92.848125	0.724944
average_map	92.783638	0.216667
mAP_test_abs_values_25	92.703125	0.828963
mAP_test_abs_values_6	92.691250	0.688247
mAP_test_abs_values_10	92.655208	0.666611
mAP_test_abs_values_7	92.528958	0.653258
mAP_test_abs_values_15	92.496667	0.625927
mAP_test_abs_values_24	92.458750	0.814472
mAP_test_abs_values_13	92.452500	0.881427
mAP_test_abs_values_8	92.422708	0.686387
mAP_test_abs_values_12	92.390000	0.771966
mAP_test_abs_values_9	92.263333	0.704280
mAP_test_abs_values	92.243125	1.102255
mAP_test_abs_values_26	91.701875	0.847692

Summary using radar plot

def extract_number(text):
    if isinstance(text, str):
        matches = re.findall(r'\d+', text)
        return int(matches[0]) if matches else 1
    return 1

res_valid1['id'] = res_valid1.index.to_series().apply(extract_number)
res_test1['id'] = res_test1.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid1,res_test1])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test1 = res_test1.sort_values(by=['id']).reset_index().query("index !='average_map'")
data_range1 = np.array(list(res_test1['mean']) + list(res_valid1['mean']))
categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test1['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid1['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "T-Test",
        'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range1.min()), round(data_range1.max()) + 1]
    )),
  showlegend=True
)

fig.show()

##############


res_valid2['id'] = res_valid2.index.to_series().apply(extract_number)
res_test2['id'] = res_test2.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid2,res_test2])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test2 = res_test2.sort_values(by=['id']).reset_index().query("index !='average_map'")

data_range2 = np.array(list(res_test2['mean']) + list(res_valid2['mean']))

categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test2['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid2['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "MU-Test",
         'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range2.min()), round(data_range2.max()) + 1]
    )),
  showlegend=True
)

fig.show()

Bit size 16

The results in this presentation are from two experimental designs:

Experiment 1 Results

The thresholding is based on fixed values between -1 and 1 on a step size of 0.1.

Validation Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
4	372	16	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	85.40	83.84	86.09	87.79	84.62	87.16	87.17	87.89	83.39	85.82	84.72	87.82	87.18	87.66	83.34	87.29	86.96	87.89	87.83	85.75	87.30	42.66	87.17	80.90	78.89	86.13
5	372	16	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	86.54	84.11	86.82	84.59	89.16	87.56	86.07	87.06	88.16	88.22	88.79	88.93	88.46	88.14	87.70	86.24	85.63	88.70	86.30	87.21	86.00	84.05	84.23	85.75	80.71	87.01
6	372	16	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	86.19	87.96	85.89	85.53	85.07	83.88	86.23	82.88	86.23	85.79	88.02	87.80	86.92	83.82	79.48	87.32	86.17	86.01	88.57	87.75	86.63	76.37	85.74	84.64	83.44	80.56
7	372	16	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	85.11	84.59	85.09	86.26	84.06	87.76	86.94	87.93	86.83	87.28	87.93	85.30	87.67	87.53	84.98	88.01	42.66	88.00	88.79	89.38	86.75	86.53	87.57	83.74	42.66	42.66
24	372	16	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	85.43	86.41	83.52	87.02	85.57	86.30	86.81	89.31	88.33	87.62	88.70	91.05	88.02	87.65	86.67	89.20	89.06	88.21	88.59	87.75	88.05	88.13	87.93	85.21	87.32	87.15
25	372	16	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	87.42	86.59	86.32	86.49	86.45	86.88	88.57	89.74	88.82	88.49	89.05	89.19	89.20	87.03	87.54	88.81	86.69	86.53	89.00	89.69	87.23	88.63	87.22	87.71	86.99	88.04
26	372	16	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	86.14	87.15	86.10	88.25	86.96	88.14	88.50	88.56	88.33	88.12	88.03	90.09	88.69	77.11	87.43	89.12	85.55	88.48	89.05	88.14	88.34	86.67	87.64	88.52	88.81	86.71
27	372	16	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	88.34	86.34	86.73	87.43	88.15	87.89	87.60	88.54	42.66	87.63	89.64	89.05	88.41	88.09	87.48	89.12	89.68	87.70	90.08	88.77	68.69	88.76	87.44	87.03	86.63	85.91
44	372	16	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	42.66	86.97	88.31	88.75	86.24	89.94	89.08	87.51	88.70	88.09	89.82	88.05	42.66	89.15	85.76	90.00	89.28	89.96	90.39	91.55	88.69	88.00	87.88	86.33	89.53	87.99
45	372	16	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	88.09	88.78	86.07	87.34	88.02	87.07	87.55	87.74	89.62	88.73	89.65	90.23	89.59	88.35	89.37	90.96	42.66	89.56	88.48	89.47	89.40	89.70	88.50	89.49	87.35	87.91
46	372	16	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	88.62	88.10	86.31	84.27	85.56	88.55	89.64	89.83	87.40	88.17	89.74	89.71	89.99	89.54	88.86	89.65	88.93	90.19	89.07	89.09	88.46	88.00	87.47	84.15	86.20	85.57
47	372	16	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	42.66	87.97	88.42	88.58	86.93	88.92	88.77	42.66	88.25	90.16	88.81	88.19	90.64	88.35	88.56	89.28	89.53	89.48	88.12	87.38	89.05	87.95	86.25	88.23	87.19	88.38
64	372	16	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	55.91	66.45	71.40	65.40	69.85	75.26	56.20	65.59	83.07	57.21	74.35	64.53	58.29	74.51	64.68	75.23	82.30	56.45	63.84	64.42	71.53	67.06	76.50	65.29	72.77	65.78
65	372	16	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	73.49	65.09	73.52	66.19	65.65	85.73	78.91	65.30	84.31	73.67	74.16	64.04	83.39	69.08	64.15	74.11	80.54	66.94	75.01	74.59	66.52	66.44	66.09	66.81	65.67	66.07
66	372	16	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	73.27	77.28	65.96	65.27	64.84	75.69	74.18	65.83	56.86	64.59	83.63	74.67	83.97	74.92	71.53	74.58	64.54	61.79	85.29	75.15	65.11	65.16	65.12	64.98	65.27	64.88
67	372	16	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	72.26	66.26	72.93	66.50	66.32	83.13	74.55	65.28	65.03	81.15	63.77	74.72	75.26	65.55	63.87	73.88	64.27	88.09	75.45	64.47	66.36	65.77	67.10	66.02	66.92	66.17
84	372	16	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	61.48	42.66	74.39	64.84	64.51	63.01	73.95	68.60	57.07	63.74	75.14	62.96	74.47	74.95	63.07	56.86	74.45	85.94	75.40	88.69	64.05	64.09	64.01	64.06	69.33	64.52
85	372	16	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	83.95	64.92	64.05	64.56	70.90	75.68	73.53	64.15	85.14	75.27	75.23	63.79	86.21	63.23	62.46	86.75	62.95	75.27	75.12	72.98	70.06	64.46	63.82	64.42	64.49	66.92
86	372	16	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	72.08	64.83	80.39	64.59	42.66	75.11	74.98	65.01	61.08	65.20	74.42	81.45	73.92	87.56	63.46	73.59	83.54	83.51	75.16	65.03	72.88	64.67	64.85	64.79	64.57	65.01
87	372	16	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	65.09	42.66	65.36	64.44	75.09	75.69	86.01	63.63	63.31	76.13	87.07	75.65	60.21	63.45	63.52	86.35	69.78	85.39	75.80	63.55	64.96	65.79	64.01	64.87	65.43	64.89
104	372	16	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	73.32	64.10	74.22	64.80	64.49	75.23	74.52	63.62	86.82	68.19	87.28	64.02	85.39	60.27	62.86	85.21	64.07	74.51	74.86	63.46	64.68	82.97	72.63	64.09	81.01	64.76
105	372	16	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	81.18	64.73	74.49	64.56	75.44	74.91	83.92	86.60	75.71	74.88	74.91	74.36	88.92	73.85	64.06	87.99	85.91	87.26	74.63	63.34	63.64	64.29	56.54	63.42	64.03	64.26
106	372	16	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	73.67	63.63	65.53	75.67	80.80	74.67	80.66	86.31	67.50	63.34	74.91	75.99	88.87	74.57	85.27	86.71	74.96	84.61	62.87	62.64	64.18	63.76	79.67	63.80	64.53	64.33
107	372	16	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	74.91	74.42	82.91	65.35	64.71	89.31	73.75	65.07	84.96	75.07	88.95	88.28	87.36	87.86	64.19	73.70	74.59	84.68	63.64	86.48	74.01	64.14	64.44	64.75	64.26	64.44
124	372	16	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	72.83	65.78	65.57	66.07	65.72	75.35	56.18	65.00	64.83	64.89	81.99	63.44	74.52	64.01	64.83	61.95	64.73	74.57	74.86	55.03	73.13	67.86	64.52	65.42	65.69	65.04
125	372	16	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	72.23	56.58	65.35	65.45	74.15	56.82	74.17	65.56	68.30	65.84	84.49	63.58	74.90	74.18	64.81	74.61	69.89	68.90	75.41	75.09	64.26	70.68	65.05	66.05	64.64	64.85
126	372	16	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	65.89	62.37	70.39	64.44	63.65	74.87	72.70	64.12	73.28	62.69	75.95	62.22	86.24	85.19	63.65	76.88	61.05	63.14	86.05	63.67	63.45	65.02	64.40	64.83	63.95	63.40
127	372	16	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	57.30	74.36	83.82	73.95	73.32	74.90	72.98	66.62	73.91	66.33	75.17	83.11	86.78	55.77	64.83	85.61	64.88	75.06	74.64	84.83	71.28	66.63	65.42	65.64	81.63	65.72
144	372	16	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	73.29	65.66	65.91	65.33	74.10	75.21	73.30	64.42	84.38	77.25	75.34	84.21	59.76	63.58	64.75	74.48	63.86	74.51	85.31	74.94	69.11	64.71	65.39	64.91	65.28	65.66
145	372	16	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	73.66	69.18	65.34	64.97	64.58	75.11	75.07	65.06	74.67	63.29	74.65	85.03	74.19	74.71	42.66	61.39	55.12	86.14	74.88	63.09	63.73	64.49	74.05	66.35	64.21	69.21
146	372	16	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	73.89	65.29	74.60	64.41	65.38	75.10	81.97	64.85	75.49	63.83	63.78	75.85	73.29	82.00	68.03	73.71	62.60	59.75	84.80	58.37	64.42	65.21	63.97	64.49	63.99	67.20
147	372	16	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	63.75	75.36	73.72	64.50	56.87	75.18	74.29	64.48	74.42	67.65	74.92	63.05	87.79	71.67	62.45	86.92	84.88	75.27	85.65	63.72	63.93	64.49	55.46	63.86	64.55	64.78
164	372	16	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	85.91	65.29	65.34	65.03	64.39	75.15	87.15	63.38	74.74	64.28	62.89	62.73	87.55	74.74	63.93	69.71	63.72	84.12	75.03	74.40	62.56	63.44	73.20	62.96	64.93	63.99
165	372	16	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	59.46	65.04	71.40	64.27	83.53	74.72	88.51	63.72	74.48	63.49	74.96	63.20	74.68	74.07	64.25	87.40	87.08	86.46	74.88	74.89	63.35	64.42	72.99	64.42	63.99	64.35
166	372	16	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	73.93	74.67	70.89	64.97	64.02	75.91	84.72	63.84	86.91	63.78	75.16	63.79	73.82	74.65	63.34	75.06	74.97	74.09	75.11	74.39	63.42	64.33	62.94	63.54	64.03	83.21
167	372	16	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	84.80	63.98	67.90	64.33	73.91	74.71	87.10	63.02	86.84	74.98	63.11	62.39	86.76	73.92	63.28	85.58	63.75	62.27	75.13	62.82	64.44	63.15	63.78	63.29	63.68	64.01
184	372	16	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	84.94	77.72	85.57	85.26	84.15	86.21	86.17	85.42	84.89	84.87	83.98	87.50	86.64	84.85	82.51	86.93	83.89	85.80	86.45	87.80	84.04	85.03	85.85	74.45	82.78	83.61
185	372	16	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	86.29	84.47	86.30	86.78	84.49	89.46	86.06	86.10	88.04	87.93	87.92	85.98	87.56	87.74	87.49	87.59	85.97	88.21	87.83	87.65	86.50	86.80	86.17	86.57	86.56	87.63
186	372	16	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	86.88	83.22	86.12	85.17	84.57	87.03	87.29	87.25	88.21	85.44	87.90	85.68	88.82	87.37	85.86	88.72	88.06	84.35	87.56	87.40	84.33	86.44	87.36	85.41	86.24	85.63
187	372	16	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	86.17	84.93	83.41	84.58	88.05	85.51	87.16	88.27	89.04	87.08	87.71	86.74	86.63	88.10	87.26	87.20	87.32	86.93	86.58	84.53	87.51	88.43	85.41	85.45	87.10	85.52
204	372	16	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	85.44	84.93	87.08	84.51	85.45	87.73	88.09	89.29	87.63	88.76	85.74	88.29	89.22	88.72	87.66	89.89	87.99	87.55	87.70	89.70	83.03	87.15	88.13	83.58	88.15	84.78
205	372	16	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	86.34	86.85	85.21	88.28	82.44	89.03	88.46	87.37	88.08	88.29	86.46	89.44	90.15	88.44	88.87	89.63	89.07	87.41	88.17	87.65	88.29	88.53	87.01	87.49	87.50	87.12
206	372	16	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	85.82	86.09	85.78	88.44	87.14	86.06	88.51	88.78	87.14	87.05	88.04	89.37	88.27	88.10	89.49	89.08	88.80	88.21	90.44	87.45	88.68	88.13	87.67	88.36	87.60	88.29
207	372	16	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	86.34	87.64	86.97	85.55	86.41	88.48	88.22	88.30	88.96	87.75	88.44	89.01	88.17	89.46	87.39	89.87	88.87	88.49	88.82	89.00	87.16	87.39	87.58	87.05	86.28	86.36
224	372	16	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	87.58	88.06	87.43	86.81	88.08	88.61	89.45	90.03	89.01	87.84	88.59	90.61	88.79	88.28	87.91	89.40	89.27	88.70	88.09	87.85	88.69	88.03	87.97	89.67	87.51	89.27
225	372	16	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	87.45	87.55	86.52	87.88	86.78	89.24	88.21	89.05	86.96	88.10	90.62	89.48	89.75	89.05	85.90	88.42	89.17	87.37	89.16	87.08	89.27	88.90	86.83	86.56	88.68	85.67
226	372	16	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	89.18	86.75	87.11	87.61	86.57	87.86	89.63	89.28	88.28	88.50	87.86	87.76	89.40	89.87	89.81	89.12	89.39	85.95	88.45	88.17	88.49	90.12	86.80	85.54	87.70	81.71
227	372	16	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	88.23	86.49	88.00	87.13	87.36	87.75	88.21	90.14	89.41	89.69	89.52	89.43	89.12	89.94	87.91	89.10	88.12	89.09	89.97	91.56	86.38	88.37	88.53	89.15	89.45	73.65
244	372	16	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	67.25	63.88	63.54	65.01	63.34	81.38	58.24	64.71	64.47	86.20	75.63	64.31	75.42	67.70	63.00	63.73	63.35	73.26	75.16	63.93	65.54	65.67	64.75	65.10	65.40	64.38
245	372	16	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	60.10	72.30	67.92	65.36	65.59	75.54	72.32	72.34	65.64	64.97	88.01	63.37	74.48	74.71	64.08	60.07	64.81	83.76	63.66	85.06	66.02	65.03	65.45	64.29	65.62	65.49
246	372	16	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	73.12	69.50	55.65	65.30	65.34	76.05	72.20	65.97	65.39	66.08	74.69	75.22	75.31	67.30	69.19	67.98	69.25	68.60	74.55	62.37	64.97	65.18	65.88	65.43	66.38	68.26
247	372	16	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	73.69	64.95	73.96	65.32	64.02	74.59	84.86	76.89	63.89	85.41	75.17	75.41	75.41	63.56	65.90	82.89	71.43	62.90	86.59	63.24	73.37	67.67	64.14	64.35	63.77	64.62
264	372	16	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	60.66	66.05	56.23	73.81	57.27	75.59	73.91	65.52	82.91	87.43	82.73	85.43	86.48	74.29	64.31	73.63	64.36	84.91	74.68	75.16	64.41	64.23	74.22	65.11	64.87	64.99
265	372	16	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	58.90	74.49	82.81	64.10	64.80	75.24	75.24	64.39	73.63	64.37	75.69	87.66	73.17	54.96	63.31	74.38	74.51	84.70	74.65	75.14	63.71	64.83	63.55	64.13	64.75	64.19
266	372	16	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	73.03	65.41	65.58	64.93	74.64	75.32	84.74	64.29	84.39	64.85	74.88	63.54	84.27	62.70	63.36	74.90	63.13	85.12	63.16	75.19	63.35	64.58	55.36	64.19	65.31	65.95
267	372	16	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	65.59	65.06	64.36	73.92	66.58	84.11	84.68	63.97	56.75	74.40	74.39	62.83	86.56	75.07	62.39	74.66	62.75	79.24	74.63	85.80	64.97	65.32	73.62	64.74	64.34	65.12
284	372	16	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	82.80	65.53	73.91	64.56	74.16	74.96	74.59	64.76	74.14	64.29	74.36	74.88	88.23	73.92	62.30	75.37	66.54	42.66	74.65	87.18	63.81	64.37	63.27	64.25	64.39	64.82
285	372	16	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	73.98	64.05	65.08	64.51	67.37	75.40	73.45	63.72	83.63	84.06	87.51	63.65	87.80	56.26	64.45	74.69	63.02	74.45	74.89	74.57	63.23	63.99	55.89	64.17	63.94	63.44
286	372	16	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	72.27	72.07	64.99	65.36	64.98	62.71	74.69	63.95	74.17	87.19	74.95	63.34	86.76	74.17	63.77	84.21	81.58	75.42	62.84	63.14	63.88	64.45	72.15	62.99	64.93	64.19
287	372	16	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	74.81	65.01	65.31	65.24	73.82	74.93	75.06	63.84	74.43	64.02	87.11	74.53	89.85	63.61	63.18	75.24	74.34	88.20	87.52	86.57	63.37	63.86	72.62	64.17	64.15	64.98
304	372	16	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	73.69	63.20	63.11	63.22	62.86	75.36	72.12	62.91	71.16	83.47	75.38	62.54	65.47	61.28	61.74	73.53	61.28	69.72	75.70	74.79	63.76	64.51	64.11	62.91	68.79	63.47
305	372	16	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	59.38	65.26	56.52	66.02	56.39	65.27	74.99	64.82	73.87	64.19	75.93	63.67	75.08	64.30	65.15	74.53	63.94	74.23	75.55	64.32	64.91	65.78	78.58	65.02	64.66	64.94
306	372	16	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	55.95	65.94	77.85	57.34	74.04	75.71	83.34	64.38	73.08	60.76	63.82	63.29	75.68	63.25	56.31	84.05	62.84	63.50	75.37	63.90	65.46	64.53	64.63	64.93	64.50	64.18
307	372	16	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	72.89	65.21	65.26	65.09	66.12	75.63	75.64	64.97	64.56	65.76	56.40	63.82	74.14	62.08	64.54	83.44	64.20	60.50	74.92	88.50	65.28	71.26	74.05	64.21	65.18	64.41
324	372	16	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	73.55	65.01	66.18	71.29	66.08	83.59	74.70	82.44	82.35	57.27	75.44	63.54	74.71	83.62	65.23	83.81	85.13	70.89	74.39	74.68	64.80	67.02	64.64	65.78	65.62	64.96
325	372	16	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	79.42	64.68	58.16	64.50	74.09	74.40	84.86	65.01	82.34	64.26	74.67	74.39	84.16	86.75	63.33	85.09	74.36	64.06	75.39	75.21	64.46	64.69	64.27	63.94	64.68	66.03
326	372	16	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	73.25	74.78	74.47	56.26	64.70	74.90	74.20	85.81	85.24	64.99	74.39	63.51	75.01	55.28	63.05	74.11	63.51	73.12	75.16	81.44	64.68	65.04	55.52	64.61	64.84	64.74
327	372	16	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	73.94	64.59	64.47	65.06	60.76	74.98	88.40	70.52	64.23	65.25	75.23	63.21	87.47	85.64	63.48	74.99	55.44	75.19	55.78	63.39	63.16	65.12	65.37	64.01	64.10	65.55
344	372	16	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	62.74	65.06	64.57	65.02	64.61	74.72	87.01	75.21	86.54	88.28	74.71	75.42	85.04	74.26	62.92	88.15	63.55	55.51	86.95	64.52	63.68	63.92	63.97	65.01	64.59	64.07
345	372	16	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	74.02	64.59	79.16	73.85	56.15	74.40	85.87	63.84	86.06	64.76	88.33	73.85	86.34	56.50	64.23	75.07	87.06	74.68	74.65	63.44	64.06	64.04	73.39	64.92	64.54	64.24
346	372	16	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.88	70.02	83.71	65.31	63.74	75.15	89.05	63.62	74.71	61.45	86.44	74.90	73.61	85.85	63.39	74.50	55.28	86.80	74.35	74.39	63.16	64.70	64.42	64.19	64.01	67.97
347	372	16	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	74.66	85.20	64.93	64.32	65.05	87.69	87.14	64.79	87.55	75.50	74.42	87.55	85.24	63.52	55.78	87.12	84.40	75.11	87.66	74.94	63.67	63.76	64.42	64.17	64.82	64.19
364	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.83	90.65	90.52	90.84	91.25	90.71	90.46	90.08	90.23	91.16	90.44	90.50	90.70	90.03	89.08	92.09	91.46	90.49	91.05	90.14	90.32	89.07	88.99	88.95	88.58	89.92
365	372	16	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	89.89	90.04	90.61	89.50	90.34	90.99	90.32	91.40	89.33	90.11	90.67	90.40	91.27	89.43	90.37	90.47	90.40	89.39	92.19	91.14	89.34	89.04	88.82	88.23	89.45	89.02
366	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	88.09	90.31	89.47	89.60	89.78	89.14	88.60	90.69	89.88	90.90	90.89	90.47	92.26	89.33	90.11	90.91	89.57	91.24	90.05	89.90	90.76	90.01	90.68	89.30	89.74	89.41
367	372	16	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	90.37	90.59	90.25	89.82	90.79	89.84	88.53	89.92	90.67	89.62	90.54	91.52	90.82	89.81	88.92	90.23	89.72	90.38	89.92	91.21	89.84	89.09	89.37	89.33	90.21	88.56
384	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.12	91.37	90.78	90.27	90.99	88.86	91.50	90.69	90.38	90.43	90.98	88.94	89.60	88.67	90.91	89.61	91.14	90.66	91.23	92.01	89.22	88.75	89.48	88.20	87.71	89.54
385	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	89.83	90.67	90.50	90.65	91.48	89.89	90.60	90.62	90.17	90.69	90.08	92.40	90.50	89.58	90.93	91.17	90.55	90.64	92.41	90.96	88.98	89.34	89.52	88.77	89.10	88.37
386	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	89.92	90.27	91.34	89.98	91.18	89.01	90.26	91.03	90.44	91.14	89.61	90.59	90.23	91.07	90.15	90.17	91.61	88.91	90.55	91.07	89.59	89.70	88.24	88.81	88.80	89.55
387	372	16	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	90.16	91.51	90.02	90.07	90.37	89.46	90.34	88.90	90.40	90.80	90.40	89.37	89.19	89.89	89.95	89.84	89.90	90.49	90.51	89.22	90.13	90.06	89.38	87.61	90.08	88.96
404	372	16	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	88.96	90.35	89.22	89.42	89.22	90.33	89.89	90.04	90.36	89.92	90.86	90.14	90.17	89.87	90.66	90.58	89.84	88.91	89.23	90.60	89.36	76.78	88.31	89.40	76.35	90.89
405	372	16	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	89.73	90.68	89.80	89.82	90.74	89.26	90.14	91.24	88.89	89.60	90.26	90.95	91.67	89.63	90.39	89.39	90.36	90.55	90.43	89.42	89.36	89.19	88.73	89.65	76.12	90.33
406	372	16	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	90.70	89.86	90.55	91.28	89.25	90.47	88.81	89.44	90.32	90.44	90.09	92.11	89.72	89.93	89.12	90.06	89.62	90.23	90.13	92.20	88.11	88.47	89.15	89.02	89.93	88.51
407	372	16	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	89.30	89.54	90.38	89.92	90.90	90.26	89.29	90.71	90.80	89.43	90.67	89.12	89.03	89.43	89.89	89.42	90.68	91.04	89.30	89.98	89.00	89.94	88.36	88.52	89.58	89.45
424	372	16	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	68.83	64.77	64.51	64.92	65.08	75.11	75.11	64.13	87.26	64.89	74.42	74.75	71.05	73.11	63.86	74.25	70.71	73.56	75.16	74.34	63.86	63.90	73.87	64.41	87.23	73.37
425	372	16	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	74.06	64.54	64.28	64.20	64.15	87.54	74.67	63.46	65.32	63.63	71.16	74.53	73.88	74.07	63.55	73.88	73.67	73.05	73.80	88.15	62.16	64.05	73.27	64.88	73.36	64.24
426	372	16	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	68.92	63.89	63.96	64.30	64.22	74.59	74.30	63.71	64.05	70.36	71.91	74.28	73.71	73.13	63.23	74.34	74.14	73.29	73.81	74.50	63.84	63.69	73.39	64.07	63.55	64.91
427	372	16	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	73.59	64.86	64.45	64.76	64.31	74.79	70.46	69.46	75.62	64.29	74.37	74.24	73.92	73.70	63.34	73.39	70.74	73.47	74.06	71.07	73.21	64.04	72.91	70.12	72.69	86.80
444	372	16	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	74.36	64.95	64.26	65.10	65.25	74.04	74.51	64.41	69.78	65.19	74.09	74.33	73.11	73.42	63.75	73.93	64.11	74.14	73.55	73.72	64.07	63.95	73.41	64.91	73.18	64.49
445	372	16	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	73.40	64.38	63.44	63.52	64.76	74.95	73.91	63.84	64.57	64.39	74.37	74.28	73.40	71.20	62.96	73.88	63.97	73.43	74.02	74.03	63.69	63.26	73.37	70.32	72.58	70.83
446	372	16	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	74.56	64.56	64.17	65.13	64.49	74.36	88.99	64.16	64.01	64.51	74.12	73.97	73.12	74.25	63.03	73.31	63.85	73.42	74.11	75.31	63.94	64.53	72.84	64.34	69.68	65.04
447	372	16	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	73.07	64.20	69.02	64.52	64.53	74.37	74.37	64.48	65.75	64.80	74.12	74.00	88.53	73.73	63.34	73.35	74.81	73.56	74.34	75.71	63.21	63.65	73.90	64.76	73.41	73.57
464	372	16	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	64.94	64.36	64.22	65.02	64.76	74.85	74.73	63.62	89.11	63.99	74.61	74.59	73.14	63.02	63.00	73.10	63.64	73.11	73.83	74.26	63.74	63.21	72.63	63.44	64.07	65.03
465	372	16	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	65.70	64.60	63.92	64.49	64.18	74.90	74.82	69.98	64.79	65.05	74.09	87.17	71.53	73.57	63.24	73.46	63.17	73.11	86.99	73.01	62.74	64.74	72.17	64.65	73.81	65.01
466	372	16	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	65.01	64.93	64.51	64.78	64.96	74.92	74.06	62.96	64.17	65.25	74.58	74.26	73.41	63.21	64.33	73.89	63.89	73.05	73.84	74.04	64.47	64.19	73.28	63.94	73.41	64.42
467	372	16	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	64.80	65.04	64.76	64.96	64.13	74.42	74.35	62.82	64.58	64.56	74.58	73.53	73.15	71.85	63.51	73.49	87.54	74.32	73.86	70.55	63.69	63.94	72.43	64.63	64.20	64.76
484	372	16	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	70.58	64.51	88.26	65.01	65.20	74.86	74.26	64.86	64.78	70.75	73.37	73.49	73.70	72.22	64.21	72.79	72.81	73.85	74.11	75.01	73.26	63.64	72.70	63.96	70.48	73.86
485	372	16	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	70.06	64.74	62.96	64.81	64.34	74.51	88.45	63.16	71.23	89.24	74.14	74.76	73.64	73.69	63.66	87.65	63.43	73.69	73.79	74.68	62.71	63.51	72.92	64.63	73.29	73.40
486	372	16	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	73.61	65.37	69.37	65.76	64.69	70.55	73.75	64.21	73.51	64.84	70.89	74.59	71.80	73.28	64.35	73.52	56.34	72.99	73.28	72.21	64.32	65.42	72.91	65.46	73.83	72.62
487	372	16	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	73.63	64.15	85.49	64.02	64.78	75.00	74.66	63.93	87.94	64.70	71.82	71.29	73.59	71.19	63.80	70.83	88.18	73.28	71.50	74.61	63.64	86.43	70.26	73.54	70.52	74.14
504	372	16	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	73.80	64.86	69.39	64.04	64.04	74.88	86.86	64.27	73.81	64.06	74.34	74.01	73.13	73.35	63.82	72.66	74.48	70.52	74.91	75.02	62.39	64.59	73.19	64.57	74.09	64.49
505	372	16	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	74.38	63.92	86.77	64.45	64.51	74.54	74.24	63.64	63.85	64.84	74.09	74.27	73.97	73.57	63.77	74.12	74.26	73.69	70.90	75.20	64.24	63.94	73.30	63.75	73.90	74.42
506	372	16	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	64.34	64.52	63.65	64.65	64.66	74.06	74.18	63.81	74.04	64.55	71.22	88.43	90.32	73.87	63.77	73.76	63.72	73.83	73.62	74.54	63.15	65.01	70.47	63.96	63.72	64.53
507	372	16	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.03	64.70	63.32	64.42	65.00	74.43	73.54	65.04	64.10	64.78	71.09	74.72	72.93	73.46	64.19	74.00	70.52	73.00	73.79	74.40	63.87	63.94	73.16	63.94	71.03	73.85
524	372	16	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	69.43	64.97	64.37	65.29	64.22	75.14	87.95	88.84	69.36	64.60	73.84	74.89	73.15	62.91	63.87	71.22	63.64	73.67	74.33	75.02	65.01	63.72	72.69	65.03	73.33	64.10
525	372	16	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	87.00	64.11	64.76	64.93	64.72	74.33	73.58	64.48	64.62	65.65	73.84	63.57	73.13	73.86	64.13	73.10	64.01	70.93	74.60	75.13	64.37	64.08	71.89	64.33	63.59	74.34
526	372	16	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	65.59	64.70	64.43	64.92	64.51	63.90	74.78	63.84	63.67	69.38	73.76	70.30	73.15	62.71	62.85	73.50	63.35	71.87	74.09	70.15	63.69	63.80	73.07	64.66	73.62	73.36
527	372	16	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	74.06	64.98	86.98	65.26	65.00	63.42	73.85	64.60	64.18	65.18	70.87	69.42	73.63	73.35	64.31	72.40	63.06	87.33	74.21	74.01	63.42	64.91	73.18	64.63	64.01	73.61
544	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	91.80	90.66	89.94	90.48	90.14	92.50	89.20	89.98	89.72	89.89	90.71	91.28	90.89	90.77	90.12	90.96	90.81	91.07	91.73	91.33	89.36	90.16	90.15	87.45	89.64	89.32
545	372	16	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	90.12	89.96	90.82	90.99	89.82	91.41	91.20	89.14	88.99	90.84	89.52	89.84	89.31	90.25	89.20	90.74	88.82	90.94	91.25	91.05	88.20	89.16	90.16	88.11	88.92	89.54
546	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	90.48	90.29	91.53	90.24	90.14	89.13	91.42	89.05	90.21	90.46	91.04	90.26	90.14	90.75	89.83	90.83	90.18	91.15	91.61	91.02	88.69	89.09	88.97	88.27	91.08	89.75
547	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	88.22	91.78	89.63	90.66	90.89	91.19	90.07	91.62	89.81	89.60	91.12	90.58	92.60	90.47	90.61	90.67	90.44	92.16	90.29	91.07	90.18	90.53	89.50	89.07	89.26	89.51
564	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	88.86	90.97	90.45	89.55	90.32	91.81	91.16	89.89	91.35	92.64	91.10	90.29	90.72	90.53	90.88	92.72	91.17	91.43	89.90	90.35	88.72	89.03	89.06	88.50	89.53	89.44
565	372	16	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	88.36	90.81	90.01	89.44	90.88	89.31	90.38	90.81	90.70	89.32	91.08	89.83	89.57	90.34	89.22	90.41	90.31	91.26	90.12	90.65	88.82	88.29	88.29	88.31	90.20	89.12
566	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	91.04	89.42	90.70	90.58	90.29	91.38	90.16	89.90	90.43	90.31	90.96	89.94	90.66	90.62	89.87	90.61	89.18	90.45	89.87	89.76	90.14	89.40	88.86	89.05	89.87	89.06
567	372	16	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	90.45	90.98	89.29	88.05	90.47	89.49	90.19	89.85	90.57	89.26	91.50	89.63	90.23	90.82	89.30	90.25	90.24	90.18	89.71	90.35	89.45	89.20	89.67	88.94	89.56	90.14
584	372	16	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	88.85	89.16	91.17	88.87	89.88	88.26	89.87	90.24	90.59	88.53	90.58	88.88	89.38	88.27	88.33	88.10	89.69	88.88	90.93	90.41	89.56	89.42	88.97	89.47	89.24	88.20
585	372	16	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	88.74	90.28	90.01	89.57	90.45	90.31	90.50	90.93	90.09	90.69	89.91	90.75	89.11	90.24	88.53	89.91	89.40	90.48	89.89	90.92	89.99	88.97	89.70	88.65	89.99	75.20
586	372	16	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	90.59	89.16	90.67	90.24	90.26	88.11	88.81	89.25	90.64	89.92	90.25	91.67	89.77	90.21	91.16	89.12	89.71	88.85	90.71	89.86	89.83	89.50	87.77	88.82	90.15	90.07
587	372	16	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	89.00	90.41	90.89	91.69	90.08	90.15	90.67	90.16	89.95	90.16	89.36	89.24	90.59	90.65	89.51	90.21	90.14	90.45	90.14	91.42	90.14	88.79	88.67	88.62	90.72	89.18
604	372	16	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	74.54	65.17	64.66	64.92	65.26	74.61	74.88	64.58	64.92	64.55	73.87	74.08	71.05	87.22	64.03	74.09	74.22	70.94	89.09	74.83	73.61	64.26	72.69	64.47	73.67	73.61
605	372	16	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	68.79	63.67	63.55	64.28	64.27	74.23	74.28	63.34	74.25	64.41	74.37	74.65	73.84	73.83	62.58	73.10	64.10	73.41	74.46	75.16	56.07	63.61	74.14	63.21	71.61	74.38
606	372	16	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	74.36	64.37	64.77	64.36	88.33	74.64	73.78	63.57	64.49	64.92	74.37	74.99	73.66	63.35	64.54	73.68	87.17	86.75	73.77	75.04	72.31	64.48	86.56	64.37	73.44	73.95
607	372	16	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	65.39	64.71	64.97	64.61	64.71	74.56	74.51	64.05	86.54	70.10	74.12	75.11	74.41	88.28	63.75	73.95	63.82	72.82	75.05	89.11	63.73	65.27	70.50	64.42	74.94	70.96
624	372	16	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	64.11	63.91	64.06	64.52	64.76	74.36	70.80	63.36	64.33	63.98	74.83	74.43	73.61	73.85	63.52	74.06	63.67	73.66	71.29	74.23	63.40	54.66	73.52	64.50	63.33	74.22
625	372	16	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	74.43	64.49	64.06	64.77	63.96	75.09	74.05	64.42	71.79	64.44	74.33	73.75	73.92	73.38	63.88	73.54	70.66	73.36	74.35	75.02	62.69	65.22	70.02	70.71	63.19	73.31
626	372	16	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	74.09	64.62	64.45	64.74	64.67	74.51	74.09	64.01	63.92	64.71	74.36	74.36	73.65	72.95	63.25	73.51	64.25	72.85	74.17	73.73	62.71	64.17	72.44	64.97	62.71	64.58
627	372	16	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	74.60	64.10	64.63	64.84	65.13	87.73	73.96	64.78	63.80	64.26	74.86	74.96	73.57	74.34	63.03	74.06	63.29	70.59	73.60	73.74	73.16	64.31	73.40	64.26	86.98	72.87
644	372	16	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	69.18	64.12	64.29	64.86	64.63	74.37	73.81	64.24	86.88	65.05	70.81	73.79	72.87	62.78	63.73	88.71	71.23	73.07	73.86	73.58	63.80	64.65	72.90	65.26	64.73	73.18
645	372	16	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	73.55	64.05	64.47	64.56	64.62	63.10	74.38	64.28	64.70	64.83	74.33	63.94	88.46	62.89	63.43	73.30	64.41	73.31	73.60	74.53	64.45	64.28	72.89	63.92	65.15	64.65
646	372	16	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	65.34	64.93	64.51	64.74	64.24	74.96	74.51	69.99	64.80	64.82	74.08	63.09	73.67	63.19	63.44	89.27	63.33	74.27	74.11	73.73	63.16	63.81	72.39	64.07	64.71	65.48
647	372	16	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	65.67	64.63	65.25	64.90	64.48	74.36	74.06	63.67	64.91	64.30	74.62	87.73	73.57	73.90	64.20	73.60	64.45	73.10	74.86	71.39	64.52	64.14	72.67	64.42	63.77	73.39
664	372	16	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	69.02	64.60	64.00	64.17	64.27	70.72	74.91	88.57	70.82	64.77	74.37	74.25	73.65	73.74	62.13	72.51	73.62	73.32	74.57	74.28	63.69	63.91	72.64	64.56	74.56	64.33
665	372	16	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	74.26	64.46	63.94	65.13	65.00	74.95	74.93	63.51	64.32	70.17	71.52	75.20	73.57	74.55	63.52	74.04	70.21	74.59	74.11	74.43	63.00	63.94	73.15	63.52	72.87	73.83
666	372	16	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	74.76	65.38	65.22	65.30	65.00	74.67	69.92	64.98	74.04	65.78	74.56	71.76	71.63	72.85	64.40	74.76	73.30	87.30	74.01	73.75	63.98	64.71	72.95	73.60	73.29	74.26
667	372	16	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	74.48	64.26	63.80	64.29	64.74	74.39	74.06	64.60	64.18	63.61	73.84	71.39	88.50	72.79	62.46	73.46	74.26	72.83	75.76	74.26	74.11	64.99	74.83	65.56	73.83	73.61

Test Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
4	372	16	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	92.13	90.03	91.21	93.68	90.91	92.15	92.58	93.98	89.66	91.39	90.65	91.98	92.93	93.71	88.78	93.16	92.87	93.73	94.88	92.31	94.11	49.17	93.67	86.99	84.48	92.42
5	372	16	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	93.51	90.57	92.80	90.41	94.07	91.14	93.65	93.53	93.49	93.69	92.13	90.20	93.33	93.39	93.37	92.58	93.09	93.53	88.46	92.71	92.63	91.12	91.05	92.03	85.56	94.22
6	372	16	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	92.05	94.25	91.21	92.07	92.05	87.54	91.05	89.09	92.84	92.46	91.00	93.21	92.75	89.39	86.00	93.17	91.45	91.35	93.69	89.22	92.59	80.87	92.02	91.47	90.67	88.71
7	372	16	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	90.92	90.93	92.46	93.54	90.77	92.58	91.78	93.29	93.91	93.50	92.43	86.00	92.37	93.30	92.13	93.35	49.17	92.38	94.85	92.69	94.48	93.14	92.81	91.35	49.17	49.17
24	372	16	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	92.56	92.98	89.99	92.31	92.93	90.60	92.89	94.37	94.61	93.21	92.46	92.50	92.30	93.28	91.09	93.69	94.77	92.45	93.76	94.01	93.40	94.74	93.70	92.80	92.98	94.00
25	372	16	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	93.29	91.94	93.10	91.80	93.68	90.74	93.97	95.10	94.04	93.91	92.99	93.71	89.47	92.79	92.96	93.71	92.89	91.11	94.17	93.90	93.74	93.87	94.23	94.40	94.42	94.34
26	372	16	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	93.14	93.65	92.74	91.50	93.27	92.91	95.38	94.35	92.94	94.58	93.40	93.00	94.60	83.45	93.06	92.99	91.67	93.04	94.65	94.10	94.13	92.28	94.55	94.22	94.82	92.91
27	372	16	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	94.03	94.15	93.00	92.48	92.71	92.65	94.27	93.88	49.17	93.61	93.90	91.86	94.86	94.36	91.82	93.57	94.62	91.53	93.77	92.55	71.47	94.95	94.98	93.28	93.18	92.11
44	372	16	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	49.17	93.34	94.38	94.02	91.61	92.08	92.99	93.00	93.68	91.73	93.87	91.42	49.17	93.54	91.59	94.88	95.05	93.57	92.51	94.32	94.31	94.33	94.57	94.22	94.59	94.87
45	372	16	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	93.83	94.29	92.60	93.40	93.15	90.55	92.57	93.63	94.17	94.75	92.85	93.54	93.67	94.11	93.98	93.41	49.17	92.24	93.31	93.93	94.70	94.72	92.82	90.45	95.02	93.01
46	372	16	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	94.98	93.75	94.15	89.26	92.38	93.69	94.44	95.95	92.61	93.69	93.94	91.82	95.29	93.35	95.03	94.89	94.09	93.88	93.37	92.61	95.19	94.47	94.33	92.17	92.05	91.56
47	372	16	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	49.17	92.96	93.98	94.06	92.71	94.37	92.79	49.17	91.40	94.58	92.94	92.49	93.27	93.67	93.56	93.76	95.42	92.98	93.41	89.74	94.24	93.84	88.58	93.78	93.26	94.71
64	372	16	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	50.17	58.87	67.68	58.42	65.79	76.28	51.34	57.37	87.15	51.77	76.49	57.01	55.76	75.98	58.62	75.96	86.99	51.12	57.25	56.65	67.03	58.95	79.99	57.19	68.51	57.54
65	372	16	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	73.76	58.29	74.67	59.67	59.19	90.69	83.04	58.49	87.77	74.55	76.42	57.32	87.74	64.73	58.60	75.61	84.36	60.58	76.38	77.08	58.69	58.17	58.13	58.25	57.83	57.79
66	372	16	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	74.77	80.13	59.15	58.20	59.15	75.67	75.79	58.20	51.25	57.19	88.23	76.42	88.84	76.34	69.09	75.59	57.80	60.45	88.71	77.10	57.43	57.47	57.27	56.73	56.95	57.17
67	372	16	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	73.21	59.17	74.46	59.43	60.23	88.33	75.07	58.74	59.13	83.94	57.29	75.35	76.03	59.21	57.89	74.43	58.52	88.24	76.99	56.88	58.52	58.62	58.30	57.59	58.34	57.80
84	372	16	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	59.32	49.17	75.17	57.52	57.83	57.58	75.20	59.91	51.82	57.66	76.26	56.88	75.99	76.34	56.99	51.07	77.07	87.83	76.22	92.62	57.48	56.14	56.22	56.41	66.21	56.41
85	372	16	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	87.21	57.49	58.97	58.25	67.86	76.46	74.67	57.36	89.52	75.93	76.98	57.54	89.64	57.23	56.11	90.74	56.37	76.29	76.57	75.56	63.04	56.90	56.16	57.05	56.44	59.86
86	372	16	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	72.93	58.31	83.79	58.56	49.17	75.64	75.60	58.31	55.49	58.26	75.19	85.62	75.54	91.63	58.03	75.12	87.48	86.85	76.34	57.33	71.68	57.14	56.81	57.07	57.13	57.43
87	372	16	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	58.89	49.17	57.77	58.69	74.24	75.82	88.96	57.29	57.80	75.75	89.98	77.21	54.25	56.88	57.20	88.45	64.01	87.99	76.47	56.04	57.70	57.15	56.61	56.80	56.85	56.28
104	372	16	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	75.06	58.95	75.42	58.28	58.55	76.19	75.03	57.50	88.48	61.70	91.58	57.04	87.89	56.49	57.10	88.24	57.77	75.65	75.87	56.88	57.84	86.27	76.23	56.68	85.27	57.14
105	372	16	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	86.07	58.20	74.71	57.26	74.64	76.23	86.85	90.58	75.53	75.79	75.48	75.91	89.62	75.91	57.86	90.41	88.90	89.94	76.02	56.86	55.97	57.19	50.56	56.10	55.98	56.87
106	372	16	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	74.94	57.70	58.83	75.26	85.52	75.90	83.39	87.44	61.35	57.49	76.17	77.29	91.10	75.33	87.67	90.49	76.11	89.88	57.33	56.73	56.44	55.86	81.95	55.99	55.98	59.02
107	372	16	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	74.64	74.73	88.51	58.97	59.13	90.33	75.32	57.79	88.81	75.38	90.88	91.74	89.73	90.28	58.95	75.60	75.38	87.47	57.70	91.55	75.95	56.56	56.49	56.45	57.32	57.01
124	372	16	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	74.15	59.78	59.60	59.85	59.34	76.32	51.47	57.58	59.01	58.46	86.94	57.27	75.57	57.65	58.29	57.28	58.20	75.27	76.85	49.79	72.21	59.17	57.73	57.80	57.90	57.87
125	372	16	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	73.77	50.53	59.19	58.75	73.99	50.69	75.06	58.47	64.17	59.41	88.09	57.61	75.87	77.06	58.26	76.41	63.88	62.81	75.85	77.36	57.21	68.71	57.02	57.57	58.79	57.75
126	372	16	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	61.90	55.76	66.50	57.72	58.76	75.47	74.48	56.75	74.87	55.60	77.19	56.32	90.07	88.95	57.40	79.22	54.70	63.19	90.72	56.18	56.05	56.79	56.92	56.45	55.63	55.80
127	372	16	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	50.67	77.26	87.78	74.95	73.98	75.38	74.45	58.82	75.68	58.56	76.28	88.51	88.68	50.73	58.81	89.38	57.34	74.62	75.91	90.68	65.43	58.09	57.65	57.70	86.09	58.12
144	372	16	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	73.46	58.44	59.47	59.30	74.59	75.71	73.38	58.25	87.50	80.00	76.31	88.48	57.21	58.51	58.58	75.44	58.15	77.20	89.93	76.55	65.42	57.23	57.02	57.15	56.66	57.83
145	372	16	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	74.92	63.06	58.51	58.17	58.08	75.54	75.07	58.57	75.25	56.66	77.00	89.91	75.70	75.04	49.17	57.82	49.49	89.26	76.51	56.28	56.66	57.39	76.57	59.84	56.07	64.83
146	372	16	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	75.02	58.51	74.51	57.87	59.22	76.25	84.52	56.82	75.34	57.16	57.04	76.37	77.10	84.33	61.63	75.60	57.01	56.43	89.31	50.83	56.80	55.77	56.10	56.68	56.47	58.10
147	372	16	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	59.16	76.12	74.61	57.66	50.62	76.05	74.75	57.01	76.16	61.80	76.80	57.29	89.42	64.37	56.90	89.92	87.24	76.91	89.33	55.93	56.28	56.71	50.81	56.37	57.35	56.12
164	372	16	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	90.57	58.78	58.54	58.79	58.51	75.48	89.96	57.75	75.15	57.27	58.19	57.62	90.14	75.35	58.52	68.45	57.41	86.57	75.99	76.27	56.25	55.86	76.44	56.57	56.59	56.54
165	372	16	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	53.64	57.51	65.03	58.30	86.10	76.34	88.12	57.40	75.44	57.25	75.87	57.86	75.66	74.89	58.53	90.58	91.74	89.37	76.02	76.84	56.33	56.35	76.24	56.57	56.93	56.08
166	372	16	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	75.17	74.74	67.61	58.35	57.55	76.17	88.71	58.47	91.53	57.47	76.04	57.55	75.30	75.23	58.01	76.21	76.30	75.51	75.66	76.77	56.19	56.88	56.33	56.12	56.23	87.60
167	372	16	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	88.25	55.92	62.61	58.22	75.15	75.78	90.95	58.55	89.63	75.32	58.26	56.90	90.08	74.75	58.17	89.88	57.46	56.51	76.27	56.89	56.43	57.05	56.42	56.44	56.67	56.44
184	372	16	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	90.97	84.24	92.92	91.27	90.54	92.24	92.68	90.01	90.97	92.28	85.66	93.30	92.60	91.43	90.50	92.35	90.90	91.58	90.19	92.28	91.90	91.59	93.55	77.71	87.62	92.53
185	372	16	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	92.45	90.70	93.18	93.76	92.45	92.54	93.37	92.34	93.42	92.42	92.51	90.14	93.85	94.56	94.25	92.97	92.83	92.55	93.94	93.63	93.33	93.82	94.93	92.44	90.07	93.54
186	372	16	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	93.99	89.38	91.48	90.48	90.69	91.34	93.73	92.97	93.72	92.53	92.85	90.47	94.25	93.33	92.16	92.18	95.60	89.73	93.92	92.91	90.54	93.56	94.24	91.88	92.29	90.77
187	372	16	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	92.43	90.88	89.60	91.80	94.74	91.49	92.17	93.47	93.10	92.24	92.30	92.00	91.91	93.83	92.89	92.48	92.30	92.22	91.92	89.62	93.03	93.68	92.58	93.13	94.46	91.04
204	372	16	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	93.33	90.57	93.75	90.50	91.82	92.19	93.02	93.45	92.57	92.84	90.29	92.95	93.64	93.87	94.46	94.33	93.35	92.42	92.15	92.43	90.75	93.90	95.00	90.27	94.30	90.67
205	372	16	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	92.35	92.67	90.55	94.05	90.26	92.83	95.55	93.30	91.84	93.65	88.73	92.00	92.94	93.52	94.11	93.69	94.59	93.38	90.04	90.32	94.82	94.38	93.19	93.99	92.93	92.85
206	372	16	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	91.02	91.34	92.80	94.81	92.49	90.98	92.88	94.17	92.57	94.31	92.25	92.08	92.93	93.41	94.13	93.67	95.00	92.31	93.20	92.53	94.36	93.66	93.43	94.36	93.25	94.24
207	372	16	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	92.03	92.68	93.36	90.69	93.70	90.32	93.22	94.10	93.84	93.70	89.51	93.15	93.82	93.03	93.43	93.87	94.35	94.05	93.31	92.23	94.34	93.92	93.68	93.56	93.01	92.06
224	372	16	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	93.40	94.37	94.03	92.58	93.99	93.40	92.70	95.32	94.47	92.88	89.84	91.89	93.85	94.41	91.84	93.86	93.44	92.99	92.14	93.32	94.98	94.68	93.96	94.51	95.10	94.37
225	372	16	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	95.41	93.30	93.55	93.21	92.65	92.50	92.85	94.57	90.90	93.69	94.38	91.47	94.65	94.47	90.51	93.57	94.29	89.84	93.41	93.58	94.48	95.23	93.17	91.80	93.59	91.32
226	372	16	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	94.45	91.72	93.66	93.60	93.53	91.21	93.97	95.09	92.54	94.28	90.28	92.62	93.24	96.13	92.73	94.55	93.87	91.09	92.23	92.95	94.17	94.49	92.77	93.10	94.45	87.88
227	372	16	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	93.90	92.57	94.32	92.77	94.13	89.94	95.25	95.40	93.21	94.17	92.74	92.34	93.02	94.32	91.98	92.80	93.62	94.14	94.10	93.24	92.61	94.10	94.70	94.39	94.22	77.29
244	372	16	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	62.44	57.04	57.00	63.41	56.39	82.11	53.08	56.72	56.59	88.60	76.96	56.70	76.15	59.30	56.79	64.33	56.96	75.12	76.95	56.45	57.18	57.44	56.48	56.58	57.26	57.21
245	372	16	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	56.81	69.21	63.24	59.12	59.25	75.99	74.13	67.46	58.11	58.45	92.11	56.95	75.93	75.42	57.90	56.47	57.53	88.29	56.76	89.72	57.83	57.33	56.87	57.66	57.84	57.11
246	372	16	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	73.96	64.22	50.38	58.64	59.62	76.05	74.54	59.05	58.90	58.84	75.41	76.34	74.58	61.69	62.50	60.00	62.47	60.19	76.59	56.15	57.99	57.61	58.79	58.03	58.92	63.73
247	372	16	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	74.55	59.03	75.75	58.00	57.43	75.88	89.86	80.12	56.87	89.07	76.96	77.30	75.71	56.01	58.87	88.22	64.59	56.55	89.72	56.14	74.27	61.82	56.61	56.31	56.73	56.55
264	372	16	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	56.98	59.99	50.90	74.89	50.98	76.36	74.18	58.50	87.79	89.06	88.48	91.55	89.20	75.39	59.20	74.95	58.19	87.83	75.79	76.18	57.18	57.05	75.97	57.41	57.46	58.00
265	372	16	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	56.15	74.93	86.95	58.02	58.78	75.87	75.48	58.05	75.73	57.39	76.16	90.92	76.48	49.66	56.94	75.17	76.76	87.63	76.71	76.67	56.51	57.94	56.66	56.91	56.87	56.94
266	372	16	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	74.67	58.11	59.01	58.40	74.41	75.81	90.02	57.55	88.93	58.16	76.57	57.54	88.00	57.08	57.13	75.49	56.84	88.11	57.20	76.99	56.46	56.28	50.19	56.26	58.07	57.20
267	372	16	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	64.49	57.91	57.59	72.06	64.80	89.74	87.64	56.46	50.09	76.15	76.50	56.78	91.66	75.23	57.76	75.81	56.76	82.52	76.02	90.12	57.33	57.22	75.32	57.05	56.22	56.86
284	372	16	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	86.70	59.29	74.85	58.96	74.52	75.06	75.44	58.32	74.95	58.56	75.43	76.63	88.72	74.23	57.82	76.88	59.23	49.17	75.74	92.27	56.78	57.47	56.77	56.96	57.25	57.25
285	372	16	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	75.19	58.57	58.26	58.79	60.98	75.36	75.06	58.29	87.66	87.33	91.60	57.05	89.55	50.74	57.99	75.43	57.70	75.49	76.33	75.61	56.76	56.24	49.94	56.57	57.03	56.42
286	372	16	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	74.00	70.54	58.69	58.31	59.01	57.70	74.93	58.26	74.51	90.02	75.04	58.39	89.83	74.25	58.75	85.95	83.76	76.62	57.20	56.98	56.92	56.44	76.11	56.57	57.32	56.42
287	372	16	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	76.22	58.81	59.09	57.95	75.42	75.78	74.88	57.59	74.60	57.82	89.89	76.07	91.34	58.63	57.35	75.07	75.11	90.38	90.89	91.70	56.96	57.10	76.17	56.67	56.29	57.10
304	372	16	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	75.52	55.65	56.82	56.72	57.13	77.23	74.46	56.81	74.29	87.67	77.35	55.85	64.99	53.92	56.21	76.16	54.14	64.55	77.35	77.07	55.95	56.03	56.49	55.52	63.33	55.40
305	372	16	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	51.91	58.98	51.46	59.03	51.52	66.63	75.64	57.13	75.34	57.49	76.74	56.93	74.81	57.66	57.35	76.37	57.54	74.82	76.79	57.19	56.99	56.84	84.40	57.71	57.13	56.63
306	372	16	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	50.29	58.23	82.93	50.82	74.45	76.00	87.19	57.36	75.09	60.33	56.89	56.61	76.32	56.17	50.83	87.15	57.27	56.25	77.03	55.76	58.10	56.59	56.78	56.71	56.62	56.29
307	372	16	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	74.43	58.71	58.34	58.70	60.07	75.84	79.95	57.76	57.44	57.91	50.25	56.58	76.45	58.42	59.18	87.57	57.66	56.60	76.62	90.77	58.17	68.05	73.20	56.67	57.80	57.42
324	372	16	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	74.31	58.17	58.52	67.27	59.58	86.96	75.08	85.49	85.71	50.92	75.59	57.85	76.12	88.61	59.41	86.46	89.80	67.55	75.91	75.91	58.16	58.82	57.47	56.91	57.64	57.10
325	372	16	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	85.24	57.86	52.67	57.21	75.46	75.76	87.78	58.78	86.69	57.37	75.71	75.78	86.68	92.06	57.95	88.74	75.92	58.22	76.60	76.29	56.99	55.87	57.01	57.01	56.77	57.50
326	372	16	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	74.72	75.32	75.32	50.00	59.10	75.99	74.82	90.56	89.29	57.73	75.52	57.07	76.46	50.98	57.16	76.25	57.76	74.85	76.71	86.87	56.12	58.16	50.01	57.12	57.11	57.11
327	372	16	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	75.37	58.47	61.14	57.95	53.63	76.12	91.09	63.81	57.85	58.09	76.21	57.31	89.04	88.30	58.00	75.76	49.40	75.27	50.24	56.78	56.96	57.08	56.76	57.41	57.35	57.10
344	372	16	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	57.88	58.70	58.67	58.27	58.45	75.53	90.52	76.04	89.07	90.93	75.24	75.64	88.08	75.14	58.36	90.27	58.02	49.33	91.04	57.30	57.32	56.44	56.78	57.18	67.61	56.81
345	372	16	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	74.63	57.80	81.29	75.17	49.64	75.72	88.43	57.72	90.77	57.70	90.57	75.65	86.28	51.00	58.16	75.94	90.56	75.67	75.49	56.65	56.84	56.83	75.75	56.95	56.48	57.16
346	372	16	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	75.24	64.47	88.84	58.87	58.30	75.48	88.93	58.47	75.78	56.48	89.59	76.15	75.19	90.25	58.77	75.44	50.23	90.61	76.16	76.33	56.26	57.07	56.51	57.01	56.82	62.67
347	372	16	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	74.15	87.61	58.67	58.45	58.39	89.05	88.72	57.52	89.82	75.05	75.97	90.15	88.84	57.66	49.01	91.31	89.48	74.93	91.03	77.12	56.92	56.36	56.51	56.91	56.93	57.24
364	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	92.33	94.45	92.97	94.14	93.21	91.76	92.51	91.93	92.46	92.69	93.46	89.89	91.57	93.43	93.17	92.74	93.27	92.41	92.66	92.51	93.78	90.81	92.45	92.91	93.58	92.80
365	372	16	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	92.04	92.29	92.91	91.24	93.57	93.59	90.23	91.10	91.55	92.82	93.28	92.18	93.65	92.17	93.11	90.40	93.55	92.45	90.17	91.49	92.48	94.25	92.84	93.07	93.89	92.01
366	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.34	92.56	93.06	93.04	93.89	91.68	92.30	92.52	91.90	91.73	92.41	92.55	92.29	92.76	94.20	92.92	93.44	91.97	93.54	92.52	94.24	94.07	92.62	93.55	91.52	92.06
367	372	16	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	93.42	94.00	93.65	92.29	93.10	88.73	90.10	91.36	92.23	93.95	91.58	91.08	92.43	94.40	90.37	93.81	92.82	94.50	91.51	93.09	92.67	93.38	93.51	91.42	91.69	90.48
384	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.08	93.56	92.63	93.09	92.31	87.91	91.92	92.60	91.78	92.57	92.30	91.84	92.08	91.55	93.58	93.42	93.14	92.47	93.51	91.08	93.23	93.16	92.44	92.78	92.44	93.31
385	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	93.00	94.19	93.79	92.98	93.28	90.66	91.21	91.85	92.42	93.46	92.50	92.84	92.33	93.35	93.45	93.96	93.31	92.95	91.64	90.73	93.92	94.03	93.20	93.45	92.91	92.01
386	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	91.75	93.45	92.65	92.41	92.77	91.41	93.54	93.02	91.40	93.14	92.76	91.99	92.33	94.09	91.93	92.58	93.73	92.05	92.35	92.96	93.84	93.04	93.89	92.46	93.02	91.63
387	372	16	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	92.78	93.09	91.86	93.83	92.32	90.87	92.87	92.27	91.27	92.30	91.97	92.13	91.49	93.96	93.39	92.06	93.45	93.36	88.08	88.49	94.18	91.97	92.47	92.12	92.06	92.12
404	372	16	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	92.58	92.90	92.38	93.01	92.47	89.26	93.58	92.14	92.21	92.39	91.89	90.59	93.60	93.19	93.06	93.34	93.01	90.31	93.09	91.19	94.12	78.20	94.14	94.27	76.68	92.81
405	372	16	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	92.29	93.03	92.15	92.82	93.26	91.35	94.47	93.59	91.58	93.59	92.15	92.41	92.89	93.40	94.10	93.61	94.20	90.88	92.50	92.38	93.20	93.11	93.72	92.92	76.87	91.32
406	372	16	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	93.38	93.29	92.45	92.72	93.00	91.44	93.11	93.64	92.90	92.74	92.68	93.46	93.64	94.50	93.94	91.47	94.06	91.41	93.68	93.04	93.15	93.73	92.79	93.31	94.40	91.22
407	372	16	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	92.30	92.80	92.53	91.97	94.26	91.60	94.01	91.95	91.67	90.11	92.84	92.85	92.89	93.74	93.11	93.17	93.40	92.43	93.13	92.08	94.34	93.53	93.03	92.21	94.03	93.04
424	372	16	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	69.84	57.94	58.46	58.23	59.68	74.14	74.78	58.82	88.43	58.83	76.69	74.11	67.43	73.32	59.24	72.67	69.26	74.16	75.29	74.78	57.74	59.22	74.73	57.96	90.04	74.99
425	372	16	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	74.68	57.69	58.14	57.89	57.94	90.10	75.06	57.52	59.43	57.88	69.17	75.71	74.93	73.68	58.43	74.80	74.70	74.18	76.14	88.08	57.19	56.74	74.88	58.23	74.05	57.20
426	372	16	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	70.62	57.82	57.88	57.51	58.20	74.61	75.58	57.89	57.72	68.58	69.50	75.43	73.86	74.29	58.21	74.66	74.98	74.59	76.10	74.83	57.71	57.25	76.04	57.20	56.43	57.73
427	372	16	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	74.27	58.11	58.72	57.85	58.23	75.91	68.89	68.37	76.14	58.89	74.38	75.06	75.38	74.22	58.69	74.30	70.02	74.39	74.47	69.76	75.09	57.15	75.16	67.50	73.81	88.30
444	372	16	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	74.44	59.37	58.88	58.98	58.45	75.09	74.63	58.99	67.43	58.27	75.12	75.60	74.11	73.87	58.33	73.72	60.12	73.43	75.35	73.95	57.23	58.11	75.78	57.27	76.09	57.53
445	372	16	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	73.58	57.35	57.84	57.51	59.15	74.89	73.60	58.11	58.14	58.67	75.11	74.26	72.44	68.87	57.84	73.81	58.63	74.49	74.88	75.28	57.18	56.85	75.72	68.79	74.96	69.07
446	372	16	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	74.44	58.47	58.49	58.37	58.70	75.39	91.55	58.97	57.80	57.77	75.59	74.91	74.66	72.95	58.46	73.02	58.23	73.79	75.42	75.18	57.16	58.00	75.77	59.06	67.67	58.38
447	372	16	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	74.32	58.26	68.42	58.03	58.14	74.66	74.57	58.50	59.15	58.67	75.11	75.05	90.31	74.44	58.27	73.00	75.61	74.21	74.84	75.58	57.66	57.12	76.35	57.01	75.25	76.24
464	372	16	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	58.51	58.67	58.74	58.55	59.02	75.53	74.58	58.42	92.01	57.67	76.09	74.92	74.00	57.84	58.05	71.33	58.83	73.42	74.91	75.16	57.07	58.24	75.41	57.03	59.94	57.86
465	372	16	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	58.22	58.63	58.58	58.58	59.19	75.70	73.97	68.17	57.88	59.01	75.55	90.42	68.83	74.10	58.46	73.42	57.65	71.97	90.35	75.31	57.75	57.43	75.58	58.68	75.45	57.78
466	372	16	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	58.40	58.15	58.71	58.22	60.35	75.96	73.81	58.36	58.65	57.79	75.37	75.58	74.63	59.43	58.88	72.62	58.96	73.29	75.15	75.56	57.36	57.75	74.02	57.62	75.73	58.47
467	372	16	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	59.93	58.62	58.71	58.53	58.88	74.67	74.50	57.47	58.98	58.56	74.62	75.22	74.43	69.65	59.02	72.48	90.68	73.47	75.35	70.22	56.51	57.99	76.14	58.67	58.16	57.78
484	372	16	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	69.04	57.20	91.28	58.85	59.04	76.44	73.69	59.51	58.20	68.90	74.68	75.12	72.96	68.27	59.30	74.17	72.43	75.42	75.37	75.46	74.77	57.75	75.05	57.66	68.10	75.64
485	372	16	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	66.93	57.70	58.02	58.68	57.95	75.33	88.81	56.62	69.21	91.75	75.60	74.73	75.12	74.18	58.12	89.77	57.64	73.54	71.01	75.59	56.22	57.82	74.71	58.43	75.62	75.34
486	372	16	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	73.69	59.11	65.54	59.34	58.83	67.77	75.40	57.60	74.25	59.51	69.85	74.62	68.75	73.64	59.95	74.55	51.46	72.40	75.37	69.91	57.28	58.53	75.49	57.64	74.34	75.65
487	372	16	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.71	57.91	88.09	58.12	58.43	73.66	75.28	58.33	91.11	57.82	68.68	69.31	74.67	68.92	58.69	69.02	88.98	72.35	69.23	75.08	57.40	91.52	69.68	73.63	68.98	75.58
504	372	16	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	75.40	57.74	69.25	57.59	58.09	73.72	91.02	58.93	73.85	58.39	76.29	75.04	74.56	72.14	57.18	74.48	74.21	69.21	76.36	75.06	56.85	57.45	75.31	56.62	75.48	57.10
505	372	16	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	73.60	58.17	89.36	58.03	57.72	75.17	74.63	57.55	56.77	57.80	74.64	74.81	72.83	74.68	58.99	72.74	72.83	72.52	69.13	75.89	58.40	57.46	74.56	56.70	75.97	76.42
506	372	16	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	58.36	58.01	58.81	57.76	59.81	74.73	73.03	57.84	73.93	57.95	68.18	90.11	89.34	74.24	59.55	75.04	58.58	73.43	74.86	76.11	57.38	57.82	69.69	57.46	57.72	57.06
507	372	16	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.32	58.43	58.23	58.68	59.19	73.94	71.96	58.87	58.20	58.28	69.53	75.21	74.00	73.60	58.62	72.91	69.19	73.56	74.41	74.25	58.49	57.61	75.47	57.25	68.67	75.59
524	372	16	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	68.72	58.71	58.26	59.02	59.62	76.30	89.33	90.40	68.04	57.62	75.80	75.26	74.66	58.01	58.56	68.03	58.35	73.83	74.65	75.12	58.96	57.50	75.18	57.34	75.24	57.68
525	372	16	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	88.40	58.13	58.94	59.14	59.37	74.89	73.32	59.18	58.45	58.67	75.12	58.96	73.95	73.65	58.38	74.49	59.29	68.51	74.74	75.67	58.48	58.67	75.91	57.48	57.85	75.86
526	372	16	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	58.99	58.12	58.99	58.35	57.97	56.71	75.63	58.68	58.20	68.79	75.06	70.06	74.85	58.39	57.70	72.87	57.79	67.97	75.18	69.44	57.23	57.99	74.81	57.32	75.97	75.23
527	372	16	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	74.44	59.15	89.91	59.74	59.50	58.15	74.10	58.67	58.87	58.39	69.60	68.47	75.15	74.98	59.55	68.30	58.72	88.88	74.25	75.28	56.38	59.98	75.56	58.14	58.09	76.51
544	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	92.04	93.31	90.75	91.33	91.74	92.63	92.27	92.51	92.04	92.34	91.87	91.55	93.03	91.97	93.12	92.90	93.37	92.92	92.54	92.57	92.43	92.64	92.66	90.94	92.76	91.86
545	372	16	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	92.61	92.29	91.89	92.51	92.68	93.45	93.46	92.48	91.53	91.75	92.33	90.26	91.17	93.84	92.71	91.86	87.03	93.11	91.64	90.46	93.07	93.06	92.46	91.65	93.53	92.32
546	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	92.05	92.66	92.67	92.13	93.35	91.26	92.58	92.05	89.67	92.15	91.88	92.38	91.79	93.28	91.29	92.75	93.32	94.02	92.89	93.17	93.06	93.03	93.26	92.52	93.32	92.52
547	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	91.30	92.83	91.60	93.66	92.78	92.48	92.23	93.01	92.68	92.21	93.86	91.41	91.37	92.39	89.62	92.25	93.46	92.87	91.15	91.82	92.68	93.36	88.56	92.58	91.90	92.71
564	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	93.06	93.96	91.88	92.59	92.33	91.54	92.42	91.85	92.85	90.85	94.35	88.24	91.45	91.84	95.11	90.16	91.51	92.80	92.70	92.75	92.23	93.22	93.13	92.63	94.21	93.04
565	372	16	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	91.62	93.66	93.62	92.32	92.46	87.91	92.37	91.66	91.67	91.76	92.47	91.99	89.85	93.96	93.34	92.07	93.61	92.45	89.63	90.12	93.84	93.05	93.93	93.10	92.84	92.28
566	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	91.24	92.53	93.39	93.39	92.33	91.96	91.67	92.54	91.55	93.12	92.33	91.25	93.09	92.90	93.61	92.88	94.31	93.12	92.64	92.69	93.30	92.07	94.16	92.40	93.12	90.72
567	372	16	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	92.87	93.08	93.11	91.13	93.90	92.40	92.36	92.56	92.04	91.85	93.42	91.63	91.83	93.05	92.51	92.98	93.13	91.77	89.50	92.81	94.10	94.38	93.19	93.15	94.43	91.62
584	372	16	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	91.69	94.06	93.06	92.73	93.05	92.48	92.82	92.86	92.16	91.16	92.09	89.87	92.80	92.95	92.16	91.51	92.94	91.41	92.89	92.09	93.67	93.39	92.00	92.05	92.94	90.18
585	372	16	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	91.32	93.14	92.76	90.70	92.55	92.70	94.05	94.45	92.73	93.42	93.16	91.52	92.24	93.32	93.09	93.73	93.64	94.09	92.23	92.12	94.73	93.91	94.13	92.91	92.47	77.25
586	372	16	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	92.49	92.67	93.91	92.50	92.90	91.48	93.45	93.11	91.83	90.97	93.08	93.25	92.57	93.45	92.96	91.85	93.22	92.55	92.43	91.59	94.71	92.86	92.85	91.76	93.57	91.98
587	372	16	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	93.31	92.47	93.67	92.81	92.98	91.69	94.14	92.87	91.69	93.83	94.06	91.16	92.56	92.88	93.10	92.96	93.27	94.36	93.46	93.04	93.41	93.34	93.09	92.69	92.32	92.70
604	372	16	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	74.86	59.46	59.70	59.95	59.15	74.94	74.59	59.29	59.22	59.52	75.11	74.44	68.54	89.25	59.55	75.29	73.73	69.27	89.90	75.01	74.96	58.32	75.07	58.88	76.11	75.71
605	372	16	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	68.44	57.31	57.97	57.88	57.46	75.40	74.60	57.33	74.11	58.20	75.37	76.71	74.27	74.49	57.16	72.35	58.33	73.75	74.88	76.33	48.25	56.36	75.42	57.00	69.34	75.38
606	372	16	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	74.44	58.79	57.98	58.68	92.05	76.55	73.89	57.35	58.75	58.37	74.86	75.65	74.35	58.47	59.02	75.52	88.86	89.34	75.03	75.03	73.96	57.91	90.30	58.36	75.92	74.56
607	372	16	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	58.25	59.11	59.07	58.83	60.63	74.38	74.70	58.99	89.53	67.87	75.18	74.44	74.27	89.37	58.49	74.37	58.71	73.87	74.49	89.56	57.53	58.87	68.61	58.26	75.70	67.81
624	372	16	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	58.29	58.31	58.25	58.49	59.02	75.80	68.73	57.67	57.70	58.89	75.63	75.46	74.23	73.86	58.74	74.46	58.71	74.36	69.36	74.38	57.15	47.95	74.80	58.24	56.67	76.45
625	372	16	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	73.51	57.53	58.35	58.57	57.97	75.43	74.52	58.58	69.51	57.85	75.61	75.05	74.17	74.17	58.77	72.99	68.48	73.14	75.66	74.86	57.09	58.95	68.49	69.45	56.37	74.32
626	372	16	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	74.33	57.94	59.75	59.07	58.45	75.53	74.54	58.23	58.89	58.49	74.68	75.26	74.36	72.58	58.80	74.77	57.32	74.25	75.64	74.67	57.03	57.19	75.16	57.96	56.87	58.43
627	372	16	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	74.98	58.09	58.60	58.14	58.48	89.72	73.55	59.29	58.32	59.05	75.77	75.65	74.65	74.63	58.10	74.95	58.14	69.29	75.40	74.41	75.64	57.23	75.91	56.91	88.63	75.43
644	372	16	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	71.46	59.00	58.96	58.85	59.44	75.12	74.12	58.99	89.02	57.76	69.27	74.38	73.92	58.24	58.67	88.61	68.97	73.96	75.21	74.97	55.17	58.29	75.71	58.79	57.37	75.31
645	372	16	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.43	58.11	58.98	57.61	58.82	57.73	74.19	59.08	58.32	57.46	75.55	59.10	88.30	57.98	59.12	73.37	59.12	72.73	74.44	74.43	57.23	57.26	74.93	56.51	58.00	56.83
646	372	16	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	59.10	58.15	58.23	58.57	58.94	76.05	74.59	68.25	58.21	59.16	75.06	58.13	74.68	59.39	58.74	90.30	57.35	75.71	75.17	74.82	56.64	57.69	76.10	57.04	60.45	58.63
647	372	16	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	59.18	58.63	59.25	58.44	58.45	75.79	73.89	58.22	59.35	58.27	74.92	91.72	71.74	74.97	58.60	72.57	59.12	74.29	75.03	70.31	57.59	57.72	76.45	57.72	58.02	75.82
664	372	16	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	68.03	58.57	58.19	58.43	58.26	68.52	74.36	89.26	68.61	57.64	75.36	75.52	74.25	74.96	57.35	74.67	74.71	74.14	75.13	75.30	57.75	57.03	75.19	57.06	75.83	56.63
665	372	16	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	74.93	58.71	59.09	58.39	58.45	75.54	75.25	58.00	59.52	68.19	70.27	74.83	72.88	74.97	59.01	74.38	69.49	74.38	75.78	73.34	58.38	58.03	75.47	57.09	74.94	75.51
666	372	16	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	74.98	59.73	60.45	59.17	59.19	74.93	69.13	60.15	73.88	58.71	76.26	69.72	67.45	74.02	59.43	74.26	74.07	88.88	76.30	74.18	57.66	59.20	74.99	75.39	74.88	75.42
667	372	16	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	74.41	58.14	58.29	57.24	58.02	75.62	73.85	58.78	58.21	56.96	76.05	68.68	90.65	75.18	57.83	73.50	74.82	74.74	76.84	74.50	75.07	60.15	75.94	57.21	76.14	75.50

Model performance on validation data (T-test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues = []
pvalues_real = []

for _,index in enumerate(dt_valid_sub.index):
  _, p_value = stats.ttest_ind(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')
  pvalues_real.append(p_value)
  pvalues.append((p_value >= 0.05)*1)

  

dt_valid_sub['pvalues'] = pvalues_real
dt_valid_sub['sig'] = pvalues


dt_valid_sub1 = dt_valid_sub.query('sig == 1')


max_indexx = dt_valid_sub1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
544	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	91.80	90.66	89.94	90.48	90.14	92.50	89.20	89.98	89.72	89.89	90.71	91.28	90.89	90.77	90.12	90.96	90.81	91.07	91.73	91.33	89.36	90.16	90.15	87.45	89.64	89.32
546	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	90.48	90.29	91.53	90.24	90.14	89.13	91.42	89.05	90.21	90.46	91.04	90.26	90.14	90.75	89.83	90.83	90.18	91.15	91.61	91.02	88.69	89.09	88.97	88.27	91.08	89.75
547	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	88.22	91.78	89.63	90.66	90.89	91.19	90.07	91.62	89.81	89.60	91.12	90.58	92.60	90.47	90.61	90.67	90.44	92.16	90.29	91.07	90.18	90.53	89.50	89.07	89.26	89.51
364	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.83	90.65	90.52	90.84	91.25	90.71	90.46	90.08	90.23	91.16	90.44	90.50	90.70	90.03	89.08	92.09	91.46	90.49	91.05	90.14	90.32	89.07	88.99	88.95	88.58	89.92
365	372	16	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	89.89	90.04	90.61	89.50	90.34	90.99	90.32	91.40	89.33	90.11	90.67	90.40	91.27	89.43	90.37	90.47	90.40	89.39	92.19	91.14	89.34	89.04	88.82	88.23	89.45	89.02
366	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	88.09	90.31	89.47	89.60	89.78	89.14	88.60	90.69	89.88	90.90	90.89	90.47	92.26	89.33	90.11	90.91	89.57	91.24	90.05	89.90	90.76	90.01	90.68	89.30	89.74	89.41
564	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	88.86	90.97	90.45	89.55	90.32	91.81	91.16	89.89	91.35	92.64	91.10	90.29	90.72	90.53	90.88	92.72	91.17	91.43	89.90	90.35	88.72	89.03	89.06	88.50	89.53	89.44
566	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	91.04	89.42	90.70	90.58	90.29	91.38	90.16	89.90	90.43	90.31	90.96	89.94	90.66	90.62	89.87	90.61	89.18	90.45	89.87	89.76	90.14	89.40	88.86	89.05	89.87	89.06
384	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.12	91.37	90.78	90.27	90.99	88.86	91.50	90.69	90.38	90.43	90.98	88.94	89.60	88.67	90.91	89.61	91.14	90.66	91.23	92.01	89.22	88.75	89.48	88.20	87.71	89.54
385	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	89.83	90.67	90.50	90.65	91.48	89.89	90.60	90.62	90.17	90.69	90.08	92.40	90.50	89.58	90.93	91.17	90.55	90.64	92.41	90.96	88.98	89.34	89.52	88.77	89.10	88.37
386	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	89.92	90.27	91.34	89.98	91.18	89.01	90.26	91.03	90.44	91.14	89.61	90.59	90.23	91.07	90.15	90.17	91.61	88.91	90.55	91.07	89.59	89.70	88.24	88.81	88.80	89.55
587	372	16	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	89.00	90.41	90.89	91.69	90.08	90.15	90.67	90.16	89.95	90.16	89.36	89.24	90.59	90.65	89.51	90.21	90.14	90.45	90.14	91.42	90.14	88.79	88.67	88.62	90.72	89.18
405	372	16	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	89.73	90.68	89.80	89.82	90.74	89.26	90.14	91.24	88.89	89.60	90.26	90.95	91.67	89.63	90.39	89.39	90.36	90.55	90.43	89.42	89.36	89.19	88.73	89.65	76.12	90.33

Size of the All data:  (136, 29)
Size of the Sig data:  (13, 29)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params1 = dt_valid.loc[dt_valid_sub1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params = optimal_params1.reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
2	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	92.04	93.31	90.75	91.33	91.74	92.63	92.27	92.51	92.04	92.34	91.87	91.55	93.03	91.97	93.12	92.90	93.37	92.92	92.54	92.57	92.43	92.64	92.66	90.94	92.76	91.86
5	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	92.05	92.66	92.67	92.13	93.35	91.26	92.58	92.05	89.67	92.15	91.88	92.38	91.79	93.28	91.29	92.75	93.32	94.02	92.89	93.17	93.06	93.03	93.26	92.52	93.32	92.52
0	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	91.30	92.83	91.60	93.66	92.78	92.48	92.23	93.01	92.68	92.21	93.86	91.41	91.37	92.39	89.62	92.25	93.46	92.87	91.15	91.82	92.68	93.36	88.56	92.58	91.90	92.71
3	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	92.33	94.45	92.97	94.14	93.21	91.76	92.51	91.93	92.46	92.69	93.46	89.89	91.57	93.43	93.17	92.74	93.27	92.41	92.66	92.51	93.78	90.81	92.45	92.91	93.58	92.80
9	372	16	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	92.04	92.29	92.91	91.24	93.57	93.59	90.23	91.10	91.55	92.82	93.28	92.18	93.65	92.17	93.11	90.40	93.55	92.45	90.17	91.49	92.48	94.25	92.84	93.07	93.89	92.01
10	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.34	92.56	93.06	93.04	93.89	91.68	92.30	92.52	91.90	91.73	92.41	92.55	92.29	92.76	94.20	92.92	93.44	91.97	93.54	92.52	94.24	94.07	92.62	93.55	91.52	92.06
1	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	93.06	93.96	91.88	92.59	92.33	91.54	92.42	91.85	92.85	90.85	94.35	88.24	91.45	91.84	95.11	90.16	91.51	92.80	92.70	92.75	92.23	93.22	93.13	92.63	94.21	93.04
8	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	91.24	92.53	93.39	93.39	92.33	91.96	91.67	92.54	91.55	93.12	92.33	91.25	93.09	92.90	93.61	92.88	94.31	93.12	92.64	92.69	93.30	92.07	94.16	92.40	93.12	90.72
7	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.08	93.56	92.63	93.09	92.31	87.91	91.92	92.60	91.78	92.57	92.30	91.84	92.08	91.55	93.58	93.42	93.14	92.47	93.51	91.08	93.23	93.16	92.44	92.78	92.44	93.31
4	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	93.00	94.19	93.79	92.98	93.28	90.66	91.21	91.85	92.42	93.46	92.50	92.84	92.33	93.35	93.45	93.96	93.31	92.95	91.64	90.73	93.92	94.03	93.20	93.45	92.91	92.01
6	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	91.75	93.45	92.65	92.41	92.77	91.41	93.54	93.02	91.40	93.14	92.76	91.99	92.33	94.09	91.93	92.58	93.73	92.05	92.35	92.96	93.84	93.04	93.89	92.46	93.02	91.63
11	372	16	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	93.31	92.47	93.67	92.81	92.98	91.69	94.14	92.87	91.69	93.83	94.06	91.16	92.56	92.88	93.10	92.96	93.27	94.36	93.46	93.04	93.41	93.34	93.09	92.69	92.32	92.70
12	372	16	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	92.29	93.03	92.15	92.82	93.26	91.35	94.47	93.59	91.58	93.59	92.15	92.41	92.89	93.40	94.10	93.61	94.20	90.88	92.50	92.38	93.20	93.11	93.72	92.92	76.87	91.32

Size of the test data:  (13, 34)

Difference

diff = dt[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt.columns,test_data_1.columns)):   
   diff[f'col_diff_{i}'] = (np.array(dt[cols[0]]) - np.array(test_data_1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff['negative_count'] = diff.apply(count_negatives, axis=1)
diff.sort_values(by =["negative_count"],inplace = True, ascending=False)

html_table = diff.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

# 
# show(diff)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
365	372	16	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.15	2.25	2.30	1.74	3.23	2.60	-0.09	-0.30	2.22	2.71	2.61	1.78	2.38	2.74	2.74	-0.07	3.15	3.06	-2.02	0.35	3.14	5.21	4.02	4.84	4.44	2.99	4
564	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.20	2.99	1.43	3.04	2.01	-0.27	1.26	1.96	1.50	-1.79	3.25	-2.05	0.73	1.31	4.23	-2.56	0.34	1.37	2.80	2.40	3.51	4.19	4.07	4.13	4.68	3.60	4
547	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.08	1.05	1.97	3.00	1.89	1.29	2.16	1.39	2.87	2.61	2.74	0.83	-1.23	1.92	-0.99	1.58	3.02	0.71	0.86	0.75	2.50	2.83	-0.94	3.51	2.64	3.20	3
384	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.04	2.19	1.85	2.82	1.32	-0.95	0.42	1.91	1.40	2.14	1.32	2.90	2.48	2.88	2.67	3.81	2.00	1.81	2.28	-0.93	4.01	4.41	2.96	4.58	4.73	3.77	3
385	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.17	3.52	3.29	2.33	1.80	0.77	0.61	1.23	2.25	2.77	2.42	0.44	1.83	3.77	2.52	2.79	2.76	2.31	-0.77	-0.23	4.94	4.69	3.68	4.68	3.81	3.64	2
546	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.57	2.37	1.14	1.89	3.21	2.13	1.16	3.00	-0.54	1.69	0.84	2.12	1.65	2.53	1.46	1.92	3.14	2.87	1.28	2.15	4.37	3.94	4.29	4.25	2.24	2.77	1
364	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.50	3.80	2.45	3.30	1.96	1.05	2.05	1.85	2.23	1.53	3.02	-0.61	0.87	3.40	4.09	0.65	1.81	1.92	1.61	2.37	3.46	1.74	3.46	3.96	5.00	2.88	1
544	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.24	2.65	0.81	0.85	1.60	0.13	3.07	2.53	2.32	2.45	1.16	0.27	2.14	1.20	3.00	1.94	2.56	1.85	0.81	1.24	3.07	2.48	2.51	3.49	3.12	2.54	0
366	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.25	2.25	3.59	3.44	4.11	2.54	3.70	1.83	2.02	0.83	1.52	2.08	0.03	3.43	4.09	2.01	3.87	0.73	3.49	2.62	3.48	4.06	1.94	4.25	1.78	2.65	0
566	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.20	3.11	2.69	2.81	2.04	0.58	1.51	2.64	1.12	2.81	1.37	1.31	2.43	2.28	3.74	2.27	5.13	2.67	2.77	2.93	3.16	2.67	5.30	3.35	3.25	1.66	0
386	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.83	3.18	1.31	2.43	1.59	2.40	3.28	1.99	0.96	2.00	3.15	1.40	2.10	3.02	1.78	2.41	2.12	3.14	1.80	1.89	4.25	3.34	5.65	3.65	4.22	2.08	0
587	372	16	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.31	2.06	2.78	1.12	2.90	1.54	3.47	2.71	1.74	3.67	4.70	1.92	1.97	2.23	3.59	2.75	3.13	3.91	3.32	1.62	3.27	4.55	4.42	4.07	1.60	3.52	0
405	372	16	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.56	2.35	2.35	3.00	2.52	2.09	4.33	2.35	2.69	3.99	1.89	1.46	1.22	3.77	3.71	4.22	3.84	0.33	2.07	2.96	3.84	3.92	4.99	3.27	0.75	0.99	0

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_13	90.910000	0.845123
mAP_valid_abs_values_19	90.880769	0.882246
mAP_valid_abs_values_16	90.754615	0.904172
mAP_valid_abs_values_20	90.737692	0.755449
mAP_valid_abs_values_18	90.660769	0.836286
mAP_valid_abs_values_5	90.586154	0.531876
mAP_valid_abs_values_2	90.578462	0.589121
mAP_valid_abs_values_11	90.555385	0.576810
mAP_valid_abs_values_10	90.545385	0.811199
mAP_valid_abs_values_17	90.539231	0.704940
mAP_valid_abs_values_8	90.488462	0.728856
mAP_valid_abs_values_3	90.473846	0.623465
mAP_valid_abs_values_12	90.449231	0.858744
mAP_valid_abs_values_7	90.350769	0.808965
mAP_valid_abs_values_6	90.309231	1.205753
mAP_valid_abs_values_4	90.296923	0.620234
mAP_valid_abs_values_15	90.212308	0.557063
mAP_valid_abs_values_14	90.117692	0.723754
mAP_valid_abs_values_9	90.060769	0.594116
mAP_valid_abs_values	89.985385	1.237906
mAP_valid_abs_values_21	89.600000	0.651780
mAP_valid_abs_values_26	89.415385	0.473139
mAP_valid_abs_values_22	89.392308	0.549972
mAP_valid_abs_values_23	89.205385	0.655955
mAP_valid_abs_values_24	88.682308	0.567306
mAP_valid_abs_values_25	88.430769	3.798273

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_17	93.375385	0.663684
mAP_test_abs_values_21	93.215385	0.628498
mAP_test_abs_values_2	93.176154	0.706748
mAP_test_abs_values_22	93.086923	0.903441
mAP_test_abs_values_15	93.030000	1.401196
mAP_test_abs_values_5	92.907692	0.604292
mAP_test_abs_values_11	92.862308	0.845460
mAP_test_abs_values_23	92.770769	1.376012
mAP_test_abs_values_14	92.770000	0.747117
mAP_test_abs_values_4	92.740769	0.829251
mAP_test_abs_values_18	92.713077	0.879833
mAP_test_abs_values_24	92.684615	0.633425
mAP_test_abs_values_10	92.653846	0.819345
mAP_test_abs_values_3	92.624615	0.855060
mAP_test_abs_values_16	92.579231	1.114132
average_map	92.538047	0.247422
mAP_test_abs_values_19	92.442308	0.967489
mAP_test_abs_values_7	92.422308	1.139979
mAP_test_abs_values_8	92.418462	0.652787
mAP_test_abs_values_13	92.340769	0.695479
mAP_test_abs_values_20	92.285385	0.769390
mAP_test_abs_values_26	92.206923	0.730678
mAP_test_abs_values	92.140769	0.699577
mAP_test_abs_values_9	91.813077	0.798179
mAP_test_abs_values_25	91.681538	4.514148
mAP_test_abs_values_6	91.532308	1.310948
mAP_test_abs_values_12	91.514615	1.249144

Model performance on validation data (Mann-Whitney U Test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues_mw = []
pvalues_real_mw = []

for _,index in enumerate(dt_valid_sub.index):

  _, p_value_mw = stats.mannwhitneyu(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')#, method = 'asymptotic')
  pvalues_real_mw.append(p_value_mw)
  pvalues_mw.append((p_value_mw >= 0.05)*1)
  

dt_valid_sub_mw['pvalues_mw'] = pvalues_real_mw
dt_valid_sub_mw['sig_mw'] = pvalues_mw

dt_valid_sub_mw1 = dt_valid_sub_mw.query('sig_mw == 1')


max_indexx = dt_valid_sub_mw1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
544	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	91.80	90.66	89.94	90.48	90.14	92.50	89.20	89.98	89.72	89.89	90.71	91.28	90.89	90.77	90.12	90.96	90.81	91.07	91.73	91.33	89.36	90.16	90.15	87.45	89.64	89.32
546	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	90.48	90.29	91.53	90.24	90.14	89.13	91.42	89.05	90.21	90.46	91.04	90.26	90.14	90.75	89.83	90.83	90.18	91.15	91.61	91.02	88.69	89.09	88.97	88.27	91.08	89.75
547	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	88.22	91.78	89.63	90.66	90.89	91.19	90.07	91.62	89.81	89.60	91.12	90.58	92.60	90.47	90.61	90.67	90.44	92.16	90.29	91.07	90.18	90.53	89.50	89.07	89.26	89.51
364	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	91.83	90.65	90.52	90.84	91.25	90.71	90.46	90.08	90.23	91.16	90.44	90.50	90.70	90.03	89.08	92.09	91.46	90.49	91.05	90.14	90.32	89.07	88.99	88.95	88.58	89.92
366	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	88.09	90.31	89.47	89.60	89.78	89.14	88.60	90.69	89.88	90.90	90.89	90.47	92.26	89.33	90.11	90.91	89.57	91.24	90.05	89.90	90.76	90.01	90.68	89.30	89.74	89.41
564	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	88.86	90.97	90.45	89.55	90.32	91.81	91.16	89.89	91.35	92.64	91.10	90.29	90.72	90.53	90.88	92.72	91.17	91.43	89.90	90.35	88.72	89.03	89.06	88.50	89.53	89.44
566	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	91.04	89.42	90.70	90.58	90.29	91.38	90.16	89.90	90.43	90.31	90.96	89.94	90.66	90.62	89.87	90.61	89.18	90.45	89.87	89.76	90.14	89.40	88.86	89.05	89.87	89.06
384	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.12	91.37	90.78	90.27	90.99	88.86	91.50	90.69	90.38	90.43	90.98	88.94	89.60	88.67	90.91	89.61	91.14	90.66	91.23	92.01	89.22	88.75	89.48	88.20	87.71	89.54
385	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	89.83	90.67	90.50	90.65	91.48	89.89	90.60	90.62	90.17	90.69	90.08	92.40	90.50	89.58	90.93	91.17	90.55	90.64	92.41	90.96	88.98	89.34	89.52	88.77	89.10	88.37
386	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	89.92	90.27	91.34	89.98	91.18	89.01	90.26	91.03	90.44	91.14	89.61	90.59	90.23	91.07	90.15	90.17	91.61	88.91	90.55	91.07	89.59	89.70	88.24	88.81	88.80	89.55

Size of the All data:  (136, 29)
Size of the Sig data:  (10, 34)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params_mw1 = dt_valid.loc[dt_valid_sub_mw1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params_mw = optimal_params_mw1.reset_index()
optimal_params_mw.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_mw1 = pd.merge(optimal_params_mw, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub_mw = test_data_mw1[list(test_data_mw1.columns[test_data_mw1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
2	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	92.04	93.31	90.75	91.33	91.74	92.63	92.27	92.51	92.04	92.34	91.87	91.55	93.03	91.97	93.12	92.90	93.37	92.92	92.54	92.57	92.43	92.64	92.66	90.94	92.76	91.86
5	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	92.05	92.66	92.67	92.13	93.35	91.26	92.58	92.05	89.67	92.15	91.88	92.38	91.79	93.28	91.29	92.75	93.32	94.02	92.89	93.17	93.06	93.03	93.26	92.52	93.32	92.52
0	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	91.30	92.83	91.60	93.66	92.78	92.48	92.23	93.01	92.68	92.21	93.86	91.41	91.37	92.39	89.62	92.25	93.46	92.87	91.15	91.82	92.68	93.36	88.56	92.58	91.90	92.71
3	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	92.33	94.45	92.97	94.14	93.21	91.76	92.51	91.93	92.46	92.69	93.46	89.89	91.57	93.43	93.17	92.74	93.27	92.41	92.66	92.51	93.78	90.81	92.45	92.91	93.58	92.80
9	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	92.34	92.56	93.06	93.04	93.89	91.68	92.30	92.52	91.90	91.73	92.41	92.55	92.29	92.76	94.20	92.92	93.44	91.97	93.54	92.52	94.24	94.07	92.62	93.55	91.52	92.06
1	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	93.06	93.96	91.88	92.59	92.33	91.54	92.42	91.85	92.85	90.85	94.35	88.24	91.45	91.84	95.11	90.16	91.51	92.80	92.70	92.75	92.23	93.22	93.13	92.63	94.21	93.04
8	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	91.24	92.53	93.39	93.39	92.33	91.96	91.67	92.54	91.55	93.12	92.33	91.25	93.09	92.90	93.61	92.88	94.31	93.12	92.64	92.69	93.30	92.07	94.16	92.40	93.12	90.72
7	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	91.08	93.56	92.63	93.09	92.31	87.91	91.92	92.60	91.78	92.57	92.30	91.84	92.08	91.55	93.58	93.42	93.14	92.47	93.51	91.08	93.23	93.16	92.44	92.78	92.44	93.31
4	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	93.00	94.19	93.79	92.98	93.28	90.66	91.21	91.85	92.42	93.46	92.50	92.84	92.33	93.35	93.45	93.96	93.31	92.95	91.64	90.73	93.92	94.03	93.20	93.45	92.91	92.01
6	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	91.75	93.45	92.65	92.41	92.77	91.41	93.54	93.02	91.40	93.14	92.76	91.99	92.33	94.09	91.93	92.58	93.73	92.05	92.35	92.96	93.84	93.04	93.89	92.46	93.02	91.63

Size of the test data:  (10, 34)

Difference

diff_mw = dt_mw[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt_mw.columns,test_data_mw1.columns)):   
   diff_mw[f'col_diff_{i}'] = (np.array(dt_mw[cols[0]]) - np.array(test_data_mw1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff_mw['negative_count'] = diff_mw.apply(count_negatives, axis=1)

diff_mw.sort_values(by =["negative_count"],inplace = True, ascending=False)


html_table = diff_mw.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

key_values = ['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']
print('Are the keys of the valid and test dfs same?: ',dt_mw[key_values].equals(test_data_mw1[key_values]))

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
564	372	16	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.20	2.99	1.43	3.04	2.01	-0.27	1.26	1.96	1.50	-1.79	3.25	-2.05	0.73	1.31	4.23	-2.56	0.34	1.37	2.80	2.40	3.51	4.19	4.07	4.13	4.68	3.60	4
547	372	16	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.08	1.05	1.97	3.00	1.89	1.29	2.16	1.39	2.87	2.61	2.74	0.83	-1.23	1.92	-0.99	1.58	3.02	0.71	0.86	0.75	2.50	2.83	-0.94	3.51	2.64	3.20	3
384	372	16	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.04	2.19	1.85	2.82	1.32	-0.95	0.42	1.91	1.40	2.14	1.32	2.90	2.48	2.88	2.67	3.81	2.00	1.81	2.28	-0.93	4.01	4.41	2.96	4.58	4.73	3.77	3
385	372	16	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.17	3.52	3.29	2.33	1.80	0.77	0.61	1.23	2.25	2.77	2.42	0.44	1.83	3.77	2.52	2.79	2.76	2.31	-0.77	-0.23	4.94	4.69	3.68	4.68	3.81	3.64	2
546	372	16	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.57	2.37	1.14	1.89	3.21	2.13	1.16	3.00	-0.54	1.69	0.84	2.12	1.65	2.53	1.46	1.92	3.14	2.87	1.28	2.15	4.37	3.94	4.29	4.25	2.24	2.77	1
364	372	16	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.50	3.80	2.45	3.30	1.96	1.05	2.05	1.85	2.23	1.53	3.02	-0.61	0.87	3.40	4.09	0.65	1.81	1.92	1.61	2.37	3.46	1.74	3.46	3.96	5.00	2.88	1
544	372	16	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.24	2.65	0.81	0.85	1.60	0.13	3.07	2.53	2.32	2.45	1.16	0.27	2.14	1.20	3.00	1.94	2.56	1.85	0.81	1.24	3.07	2.48	2.51	3.49	3.12	2.54	0
366	372	16	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.25	2.25	3.59	3.44	4.11	2.54	3.70	1.83	2.02	0.83	1.52	2.08	0.03	3.43	4.09	2.01	3.87	0.73	3.49	2.62	3.48	4.06	1.94	4.25	1.78	2.65	0
566	372	16	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.20	3.11	2.69	2.81	2.04	0.58	1.51	2.64	1.12	2.81	1.37	1.31	2.43	2.28	3.74	2.27	5.13	2.67	2.77	2.93	3.16	2.67	5.30	3.35	3.25	1.66	0
386	372	16	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.83	3.18	1.31	2.43	1.59	2.40	3.28	1.99	0.96	2.00	3.15	1.40	2.10	3.02	1.78	2.41	2.12	3.14	1.80	1.89	4.25	3.34	5.65	3.65	4.22	2.08	0

Are the keys of the valid and test dfs same?:  False

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_16	90.974	0.887521
mAP_valid_abs_values_19	90.869	0.873873
mAP_valid_abs_values_13	90.830	0.924794
mAP_valid_abs_values_18	90.820	0.847703
mAP_valid_abs_values_20	90.761	0.705478
mAP_valid_abs_values_10	90.722	0.840156
mAP_valid_abs_values_11	90.693	0.502639
mAP_valid_abs_values_5	90.646	0.579122
mAP_valid_abs_values_2	90.639	0.649743
mAP_valid_abs_values_17	90.611	0.795885
mAP_valid_abs_values_12	90.525	0.886720
mAP_valid_abs_values_3	90.486	0.668102
mAP_valid_abs_values_6	90.362	1.326171
mAP_valid_abs_values_8	90.355	0.722115
mAP_valid_abs_values_7	90.343	0.925275
mAP_valid_abs_values_4	90.285	0.448658
mAP_valid_abs_values_9	90.262	0.461129
mAP_valid_abs_values_15	90.249	0.592611
mAP_valid_abs_values_14	90.182	0.763789
mAP_valid_abs_values	90.119	1.381026
mAP_valid_abs_values_21	89.596	0.721175
mAP_valid_abs_values_22	89.508	0.574259
mAP_valid_abs_values_26	89.387	0.425573
mAP_valid_abs_values_23	89.345	0.691797
mAP_valid_abs_values_25	89.331	0.893426
mAP_valid_abs_values_24	88.637	0.547379

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params = dt_valid.loc[dt_valid_sub_mw1.index].iloc[:, :6].reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, how='left')
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]
test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_21	93.312750	0.653087
mAP_test_abs_values_2	93.230000	0.654538
mAP_test_abs_values_22	93.083250	0.845760
mAP_test_abs_values_14	93.057750	0.875066
mAP_test_abs_values_25	92.909500	0.807182
mAP_test_abs_values_18	92.854750	0.679227
mAP_test_abs_values_17	92.842750	1.751869
mAP_test_abs_values_5	92.831750	0.599161
mAP_test_abs_values_23	92.712000	1.315776
mAP_test_abs_values_15	92.702750	1.363160
mAP_test_abs_values_4	92.652500	0.867291
mAP_test_abs_values_11	92.625250	0.749081
mAP_test_abs_values_3	92.567500	0.856854
mAP_test_abs_values_16	92.531500	0.965679
mAP_test_abs_values_24	92.499000	0.716329
average_map	92.445529	0.227208
mAP_test_abs_values_10	92.432500	0.718830
mAP_test_abs_values_8	92.260250	0.526086
mAP_test_abs_values_7	92.204000	0.915442
mAP_test_abs_values	92.191750	0.686309
mAP_test_abs_values_26	92.136500	0.704209
mAP_test_abs_values_13	91.977250	0.826506
mAP_test_abs_values_9	91.771750	0.761839
mAP_test_abs_values_20	91.745000	1.351267
mAP_test_abs_values_19	91.652500	1.544206
mAP_test_abs_values_12	91.520500	1.076040
mAP_test_abs_values_6	91.278750	1.682754

Summary using radar plot

def extract_number(text):
    if isinstance(text, str):
        matches = re.findall(r'\d+', text)
        return int(matches[0]) if matches else 1
    return 1

res_valid1['id'] = res_valid1.index.to_series().apply(extract_number)
res_test1['id'] = res_test1.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid1,res_test1])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test1 = res_test1.sort_values(by=['id']).reset_index().query("index !='average_map'")
data_range1 = np.array(list(res_test1['mean']) + list(res_valid1['mean']))
categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test1['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid1['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "T-Test",
        'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range1.min()), round(data_range1.max()) + 1]
    )),
  showlegend=True
)

fig.show()

##############


res_valid2['id'] = res_valid2.index.to_series().apply(extract_number)
res_test2['id'] = res_test2.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid2,res_test2])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test2 = res_test2.sort_values(by=['id']).reset_index().query("index !='average_map'")

data_range2 = np.array(list(res_test2['mean']) + list(res_valid2['mean']))

categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test2['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid2['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "MU-Test",
         'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range2.min()), round(data_range2.max()) + 1]
    )),
  showlegend=True
)

fig.show()

Bit size 8

The results in this presentation are from two experimental designs:

Experiment 1 Results

The thresholding is based on fixed values between -1 and 1 on a step size of 0.1.

Validation Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
0	372	8	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	64.70	64.74	67.66	65.99	72.66	74.80	71.10	69.21	70.44	67.90	64.24	64.35	56.45	63.24	65.33	65.46	64.91	66.93	62.86	63.97	66.97	66.64	67.21	65.87	66.63	65.80
1	372	8	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	81.50	65.57	63.00	65.36	66.05	62.78	42.66	70.40	65.80	64.07	65.08	64.34	73.22	64.57	65.13	56.20	64.26	64.88	62.50	55.78	66.53	66.00	66.92	42.66	66.17	64.80
2	372	8	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	76.05	65.47	71.76	66.03	63.60	56.73	70.51	64.17	65.43	65.19	73.38	42.66	73.49	63.37	63.25	72.22	63.13	70.41	62.95	72.18	66.67	42.66	64.84	65.79	65.16	65.54
3	372	8	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	63.50	64.36	63.01	63.97	63.33	56.59	55.16	64.61	72.75	63.77	62.11	62.77	71.65	62.69	61.78	63.25	42.66	61.09	62.90	62.02	66.88	65.90	63.93	64.42	64.55	64.19
20	372	8	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	75.96	65.17	64.68	65.31	64.95	62.88	73.32	66.03	79.43	65.83	63.83	81.91	74.70	64.30	64.90	73.80	64.60	73.81	56.01	64.64	67.00	65.37	55.86	65.59	65.33	66.48
21	372	8	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	58.86	57.28	73.86	63.31	64.34	64.35	83.93	64.33	64.55	42.66	57.04	62.95	73.86	62.96	63.49	74.48	62.66	74.47	83.77	75.33	63.30	64.87	65.45	64.98	65.84	64.98
22	372	8	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	72.13	64.89	72.28	64.86	64.68	74.94	80.86	64.81	74.53	63.85	84.53	63.09	68.22	68.47	64.20	74.28	62.71	67.71	75.00	62.55	63.47	64.59	64.63	63.57	64.20	64.37
23	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	59.96	64.06	64.86	65.40	65.06	74.20	65.07	64.79	64.14	80.98	71.95	63.58	81.00	64.63	63.31	78.69	64.08	78.65	74.48	84.80	69.89	64.79	63.85	64.97	65.74	64.67
40	372	8	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	73.91	64.55	55.75	64.56	74.77	75.16	73.14	64.30	64.00	64.56	74.86	62.75	85.48	74.40	63.29	71.17	63.12	55.64	83.74	63.06	73.57	63.86	63.43	64.79	64.29	64.76
41	372	8	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	73.61	64.80	73.58	65.31	64.99	63.80	83.33	65.18	73.03	66.01	74.59	63.19	73.64	82.58	64.97	74.46	65.97	62.20	63.87	63.23	63.42	65.55	64.90	65.18	65.20	64.41
42	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	73.26	65.23	73.12	65.47	71.13	42.66	79.20	64.25	79.82	64.66	86.45	63.49	59.97	63.32	66.51	74.91	74.37	74.07	75.70	63.84	63.89	65.63	64.12	64.26	69.25	68.16
43	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	73.42	64.68	64.57	64.47	64.70	62.64	72.93	69.56	84.40	68.78	74.94	63.46	74.92	63.21	64.74	82.69	63.77	65.70	63.95	86.56	64.59	63.32	72.90	64.28	64.12	65.09
60	372	8	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	63.20	55.48	55.91	61.15	70.16	58.18	69.62	61.09	60.83	68.31	60.21	54.87	71.04	63.73	61.68	71.53	61.83	53.51	61.51	60.94	70.87	62.43	61.80	62.56	42.66	61.82
61	372	8	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	62.63	66.16	66.64	65.87	66.18	71.83	56.12	65.10	66.61	65.93	65.56	64.56	63.99	70.45	65.23	74.88	68.86	64.90	85.99	63.73	67.27	66.14	66.12	65.04	65.11	65.17
62	372	8	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	72.01	62.14	64.26	66.90	70.74	72.30	71.25	62.32	62.00	61.03	72.43	61.77	71.91	60.58	61.33	61.05	68.11	54.19	60.31	54.66	42.66	63.89	63.36	62.52	64.34	63.95
63	372	8	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	66.12	70.54	74.20	66.23	72.67	65.47	66.67	65.42	56.97	67.59	59.24	62.63	59.70	64.79	67.45	74.85	65.23	65.29	64.69	63.92	66.63	73.90	65.32	65.74	66.87	65.28
80	372	8	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	72.56	65.13	64.36	67.09	64.43	56.55	72.42	63.36	64.34	64.58	61.31	63.57	73.12	64.09	62.22	84.11	62.37	62.67	63.14	62.19	64.05	63.81	64.70	64.16	64.72	63.78
81	372	8	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	73.49	42.66	64.70	67.44	70.89	75.36	73.54	64.78	73.98	82.46	85.97	63.84	75.06	63.01	66.22	64.28	64.78	64.98	63.95	63.51	65.57	66.20	64.86	65.33	64.86	65.10
82	372	8	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	42.66	65.20	65.28	65.28	65.18	63.42	72.35	64.61	64.21	63.96	62.96	63.96	73.40	63.64	63.53	59.65	62.23	75.09	63.69	83.46	71.66	66.09	63.67	64.74	64.25	65.20
83	372	8	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	57.19	65.59	69.85	64.98	64.94	64.31	72.23	63.78	65.15	64.58	63.55	64.57	74.65	74.47	62.83	83.62	81.92	74.91	75.13	55.99	64.35	66.05	66.18	65.30	65.28	65.10
100	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	73.61	64.79	63.09	68.94	64.15	76.06	71.84	63.72	55.73	84.20	74.91	63.33	74.65	86.25	62.53	74.92	63.35	86.17	75.38	62.66	64.80	64.87	64.26	64.06	63.25	64.63
101	372	8	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	60.51	64.05	64.48	64.19	64.09	75.67	58.13	64.05	65.17	82.62	62.91	63.57	73.98	63.55	62.75	42.66	63.29	63.63	62.66	42.66	63.86	63.80	64.51	71.51	64.73	64.67
102	372	8	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	73.79	42.66	82.47	64.78	64.59	76.09	42.66	83.54	70.37	69.12	75.69	63.57	74.82	63.43	62.33	42.66	62.97	74.63	56.03	63.33	64.08	64.43	64.36	64.54	63.47	64.29
103	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	73.40	64.68	74.20	65.14	74.51	75.20	82.68	64.02	84.90	55.84	63.39	63.21	83.78	64.07	64.25	83.78	63.79	68.14	63.61	63.21	63.21	72.64	64.19	42.66	64.64	64.74
120	372	8	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	65.99	66.02	64.95	73.34	63.85	63.31	72.77	65.72	68.76	63.59	71.24	42.66	64.66	56.11	65.49	57.49	70.82	60.35	42.66	64.02	65.97	67.28	66.62	65.16	65.83	66.00
121	372	8	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	70.87	73.05	55.78	63.23	63.36	61.85	70.90	70.29	63.74	63.24	55.49	73.14	72.95	62.39	61.55	71.57	62.03	62.56	63.22	82.49	65.73	65.26	63.62	64.74	64.26	64.54
122	372	8	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	71.82	64.85	42.66	70.47	63.98	70.79	69.99	62.85	64.97	64.50	61.01	63.79	55.90	63.37	42.66	65.99	61.72	62.98	61.77	71.44	66.10	65.07	64.45	63.94	64.72	65.23
123	372	8	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	72.61	42.66	64.97	66.33	64.86	80.04	72.29	75.41	63.73	65.71	74.61	63.85	74.97	63.78	64.29	60.82	64.82	56.93	63.90	64.92	72.36	66.39	65.07	64.59	65.40	65.07
140	372	8	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	63.58	69.47	60.57	65.52	64.24	62.73	70.01	64.12	62.21	63.47	73.28	61.96	73.73	67.64	62.60	79.65	62.99	62.44	76.01	61.43	63.30	65.00	63.68	63.67	63.72	63.92
141	372	8	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	42.66	65.27	57.14	66.52	73.82	75.43	66.20	64.70	74.82	65.80	87.01	64.19	72.92	64.55	64.30	65.41	67.82	61.74	63.60	63.10	63.78	64.93	63.92	69.30	65.06	65.07
142	372	8	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	72.61	64.34	64.73	65.34	65.03	74.33	70.39	64.69	64.69	73.89	64.09	63.59	73.99	63.62	64.46	74.50	64.06	74.49	74.64	82.54	63.28	65.17	64.74	65.02	64.56	64.73
143	372	8	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	64.25	65.17	65.23	65.24	69.36	75.28	65.84	64.58	65.62	56.87	74.81	70.81	74.62	63.56	64.52	84.84	65.02	65.30	75.64	64.09	65.95	65.43	64.94	65.62	64.25	65.09
160	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	82.94	66.75	73.19	65.21	65.26	74.90	42.66	65.03	64.94	66.11	74.64	64.07	74.71	64.28	74.03	85.65	63.75	86.35	74.94	64.06	64.31	65.91	65.71	65.33	65.40	66.10
161	372	8	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	60.15	64.99	74.24	65.04	65.63	56.27	74.40	63.98	63.63	64.89	84.98	62.94	86.88	63.46	63.04	74.84	63.99	86.67	64.12	63.82	64.26	63.78	63.69	63.24	64.29	64.52
162	372	8	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	80.84	66.01	66.29	42.66	64.82	75.38	74.44	68.06	57.83	42.66	63.47	63.30	73.71	63.30	63.34	85.35	65.07	74.26	74.94	63.79	63.49	64.41	63.82	65.11	64.65	64.19
163	372	8	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	73.17	73.42	64.84	72.31	59.26	76.17	58.08	66.16	83.89	42.66	75.39	62.98	73.82	64.82	64.65	84.85	62.78	64.25	75.14	63.55	63.28	63.56	64.77	64.77	64.49	64.59
180	372	8	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	70.43	66.42	65.19	42.66	70.85	62.86	64.87	65.36	71.17	64.81	63.84	62.93	74.32	68.01	65.05	56.56	71.46	66.05	62.98	60.24	67.51	66.95	66.44	66.67	65.69	67.61
181	372	8	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	76.28	65.93	66.39	66.57	66.55	65.76	56.14	64.78	65.32	66.44	64.09	64.72	68.68	81.97	66.54	56.86	64.31	57.84	64.21	63.27	65.71	65.98	65.48	65.06	65.60	65.56
182	372	8	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	65.85	65.68	56.90	66.33	65.88	64.53	72.53	65.37	65.96	70.47	56.47	64.66	57.64	64.05	65.55	66.88	67.80	71.35	64.63	64.84	65.52	66.17	66.58	72.07	65.58	65.62
183	372	8	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	71.43	64.15	73.52	64.19	64.38	64.36	72.06	63.45	72.02	63.86	55.90	64.33	74.27	62.37	62.71	73.62	55.73	72.66	63.91	62.67	65.84	64.89	65.10	63.55	64.31	64.07
200	372	8	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	72.47	64.35	64.40	67.42	64.88	62.42	55.37	64.16	69.96	65.65	55.58	62.30	74.70	63.21	63.20	65.34	63.83	74.62	82.21	84.17	65.22	65.26	56.19	64.22	69.51	64.74
201	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	69.52	66.36	66.46	64.88	65.22	62.62	79.58	65.55	56.25	80.60	84.88	84.34	74.47	63.28	63.79	74.52	55.73	65.01	85.44	64.35	64.35	66.59	64.11	65.44	64.41	65.62
202	372	8	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	73.51	65.44	79.13	65.35	65.31	74.50	73.90	66.06	74.00	64.95	64.29	64.54	74.93	84.04	62.98	75.04	64.38	63.63	64.55	63.08	65.29	64.91	64.30	65.75	64.84	65.84
203	372	8	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	81.08	66.21	65.59	64.61	65.62	75.66	73.03	64.71	74.16	65.89	74.88	63.69	74.98	63.75	63.81	74.97	63.49	64.33	74.93	63.69	66.56	64.54	63.49	65.31	64.92	65.15
220	372	8	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	74.16	64.58	64.33	62.62	65.47	62.48	69.70	63.89	63.11	63.55	75.47	84.97	84.14	75.35	62.52	74.15	62.19	75.15	62.60	63.18	63.25	64.08	63.70	63.36	64.95	63.22
221	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	72.97	64.23	65.09	64.81	66.15	62.89	74.65	72.54	82.72	64.32	62.41	62.57	73.67	81.03	63.79	85.69	70.05	73.66	74.89	86.33	63.85	64.01	64.36	64.13	64.15	64.37
222	372	8	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	73.52	69.46	65.15	64.32	73.94	86.79	73.89	64.55	65.88	64.59	75.33	63.58	73.94	60.92	55.17	74.86	63.69	68.32	55.53	63.21	62.57	63.47	63.51	64.48	65.91	66.41
223	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	72.81	65.30	81.72	64.96	64.24	75.01	74.05	64.42	84.06	55.36	63.19	62.71	59.10	64.25	63.77	75.91	63.31	74.02	84.41	84.13	63.19	64.87	63.76	63.74	64.75	63.76
240	372	8	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	64.07	64.23	64.61	72.51	72.04	57.47	70.48	65.03	71.39	64.75	56.50	62.59	72.82	55.52	64.15	67.75	64.10	65.78	64.00	62.89	66.01	65.67	65.66	65.36	65.38	65.61
241	372	8	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	65.52	65.31	65.47	64.68	64.96	65.52	72.65	64.85	71.45	64.82	63.94	63.55	73.98	64.01	64.52	73.90	64.85	71.67	74.98	63.96	74.09	65.84	65.48	64.03	64.95	64.92
242	372	8	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	55.96	64.69	63.26	63.10	63.66	61.46	56.84	62.09	62.75	55.74	57.21	62.93	57.68	66.79	62.69	55.37	62.82	64.91	74.42	62.50	65.87	65.02	65.15	62.47	63.96	64.60
243	372	8	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	71.57	69.33	64.94	64.96	64.57	56.53	56.25	65.34	65.52	68.19	75.32	55.59	59.55	63.65	64.95	73.07	63.94	57.20	72.71	63.41	64.75	65.18	64.34	65.47	70.20	64.19
260	372	8	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	56.03	64.17	62.44	64.80	57.96	62.73	71.48	64.13	75.55	70.18	63.19	61.09	60.97	62.10	62.19	62.16	62.28	70.61	74.87	61.83	64.81	64.20	63.74	64.34	64.09	64.10
261	372	8	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	73.47	64.77	65.38	64.35	74.03	63.06	73.62	64.19	80.27	55.12	63.31	74.61	74.89	63.88	62.98	74.51	63.20	63.38	75.13	74.54	64.81	63.95	62.89	63.03	64.41	76.21
262	372	8	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	72.77	64.89	55.64	64.91	64.68	74.65	55.88	64.28	65.49	63.68	74.35	63.31	71.40	63.46	62.14	56.62	70.21	71.73	84.46	63.82	64.87	68.95	64.54	63.76	65.15	64.88
263	372	8	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	72.49	65.81	55.95	65.06	73.21	56.78	82.61	64.86	64.36	76.89	64.20	63.58	69.93	67.45	63.99	75.07	82.60	75.06	63.80	63.66	64.09	64.96	65.97	64.79	65.23	68.04
280	372	8	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	72.77	65.49	73.06	64.59	71.45	63.32	74.34	64.80	64.08	64.84	62.92	63.55	75.18	56.32	64.05	73.91	69.51	63.57	62.86	63.57	63.14	63.95	62.94	63.69	65.39	64.36
281	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	73.61	64.67	57.92	64.35	64.56	64.79	75.17	63.76	79.32	64.01	74.85	63.57	75.73	63.18	65.27	84.50	63.46	70.24	75.14	85.53	64.33	64.75	63.82	63.01	64.51	64.28
282	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	58.35	66.16	69.63	64.57	55.82	56.89	83.90	65.05	67.35	64.43	86.52	63.95	73.61	85.72	63.66	81.72	63.89	68.97	85.31	64.31	65.67	64.63	64.96	64.82	64.42	64.74
283	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	59.80	65.12	73.88	62.96	74.60	75.74	74.76	64.17	74.39	67.10	75.60	75.13	74.47	62.56	62.79	85.05	63.07	87.47	63.32	63.55	72.87	63.79	71.31	63.90	63.19	64.44
300	372	8	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	65.91	65.77	65.02	65.98	65.74	42.66	70.71	64.48	64.84	64.45	65.14	63.43	55.94	63.50	64.56	56.55	64.45	71.95	63.91	74.05	67.07	68.92	71.64	68.43	66.04	66.11
301	372	8	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	71.57	64.80	67.48	63.54	64.42	63.92	69.35	63.22	64.65	67.62	82.68	60.10	73.14	62.89	63.52	59.77	62.89	80.42	62.81	60.70	71.00	69.11	64.76	63.75	63.12	67.48
302	372	8	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	55.56	70.00	63.13	63.75	64.97	81.97	71.44	70.10	70.86	55.81	63.09	60.69	63.95	60.71	63.05	63.70	64.35	64.08	62.44	62.33	64.59	65.80	64.93	63.07	64.03	65.35
303	372	8	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	57.62	63.25	64.46	63.43	63.13	83.18	79.11	64.96	63.95	64.77	74.53	80.65	78.46	62.92	62.50	83.94	62.84	63.18	74.30	63.85	63.92	64.10	63.42	63.04	63.63	63.44
320	372	8	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	65.99	65.46	55.52	65.08	64.84	64.69	59.73	64.06	42.66	64.79	42.66	61.58	82.59	63.84	64.50	74.95	65.77	66.54	74.89	63.19	65.92	64.52	64.60	64.63	65.27	64.62
321	372	8	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	72.94	65.06	64.35	64.21	64.66	74.62	72.22	64.43	73.80	73.72	74.95	64.22	83.24	62.38	63.29	64.58	62.84	74.27	62.88	63.40	65.30	66.13	64.24	62.41	64.11	67.82
322	372	8	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	71.35	65.28	73.54	64.86	65.64	63.12	78.69	64.37	76.31	59.30	64.29	63.74	74.96	64.09	62.66	64.81	64.34	74.99	82.05	81.35	64.54	64.65	64.51	63.89	64.41	64.38
323	372	8	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	73.21	65.50	73.17	64.98	64.65	75.32	80.29	65.20	60.64	64.62	74.92	63.57	74.88	63.94	63.68	80.57	79.32	64.05	63.19	63.03	64.50	63.73	63.99	64.20	64.62	63.97
340	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	65.63	64.61	78.33	65.19	65.93	75.38	82.88	64.18	78.64	64.99	75.14	63.57	74.15	64.34	64.49	74.47	63.54	74.11	75.13	63.51	63.79	63.10	64.17	65.73	82.97	64.04
341	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	65.39	64.57	73.73	64.83	74.60	62.86	74.66	63.24	86.25	63.59	86.68	63.32	74.85	80.49	62.86	70.47	63.81	80.64	74.89	63.64	63.66	64.74	64.09	64.07	64.46	64.26
342	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.31	65.83	65.87	65.08	74.58	56.36	74.32	68.71	64.90	65.28	75.05	87.08	81.90	63.71	64.39	78.59	62.83	82.54	63.11	63.82	64.26	73.56	64.56	64.98	64.25	65.36
343	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	72.91	64.51	56.87	72.83	66.47	56.23	74.67	64.51	75.22	64.57	55.78	64.07	74.93	85.09	64.00	75.21	84.17	81.31	75.12	63.54	63.40	64.46	64.45	64.51	64.38	71.81
360	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	73.97	64.68	64.23	64.70	64.76	74.21	74.87	70.89	63.62	64.99	88.53	73.75	73.84	87.43	64.79	71.17	70.69	74.09	74.46	74.56	63.51	63.84	73.58	74.05	73.85	64.40
361	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	74.31	65.29	63.83	64.67	64.59	70.45	69.73	69.92	75.31	64.62	74.59	74.70	71.48	73.37	63.74	70.89	74.14	74.91	74.86	73.99	62.84	63.62	69.80	64.16	69.98	63.89
362	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	85.38	64.97	65.16	65.09	64.53	74.68	70.96	73.60	72.91	64.85	71.53	75.75	73.67	73.55	63.97	74.20	74.37	70.66	74.02	71.02	64.79	64.27	73.14	65.56	64.30	64.76
363	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	74.06	63.79	84.54	63.53	63.79	76.13	74.85	63.90	70.70	70.18	74.09	73.99	74.59	70.47	63.24	73.49	63.42	73.73	74.36	73.78	64.01	62.74	73.67	70.64	73.16	63.82
380	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	69.29	65.25	63.88	64.92	64.49	71.30	73.21	63.57	65.67	65.16	74.37	74.98	71.55	63.29	63.19	73.84	74.60	72.87	75.01	71.67	88.41	64.19	72.91	64.98	72.76	65.72
381	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	65.50	64.28	69.96	64.78	64.53	74.79	74.85	63.88	63.47	87.84	70.76	74.00	88.83	72.87	62.65	72.60	63.89	73.37	74.83	74.75	73.89	64.77	73.55	64.30	73.68	70.12
382	372	8	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	74.03	64.20	64.10	64.44	64.51	71.04	74.25	63.60	63.65	65.40	74.37	64.54	71.38	73.59	63.73	73.50	63.64	71.14	74.76	74.02	63.42	63.60	72.65	63.41	64.14	73.63
383	372	8	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	68.45	64.14	64.01	66.00	64.04	74.36	73.93	63.43	63.85	64.78	74.39	70.34	72.82	72.78	63.39	73.29	74.30	72.57	74.31	70.82	63.51	63.93	72.42	64.85	64.04	64.28
400	372	8	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	66.20	64.76	63.92	64.74	64.96	74.89	74.31	63.94	64.22	64.33	74.12	74.45	73.39	61.81	64.17	72.85	62.89	70.02	74.80	70.58	53.26	63.90	71.91	63.67	73.11	69.72
401	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	66.49	64.73	69.87	65.51	65.25	73.87	70.58	64.68	65.07	65.52	74.50	74.52	87.15	63.91	63.75	73.41	65.20	69.72	73.60	74.84	87.32	64.44	72.39	64.78	64.19	64.42
402	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	65.73	64.72	64.20	65.36	64.78	74.53	74.09	86.71	64.30	63.66	74.03	75.24	87.91	72.89	64.27	73.44	64.07	72.81	73.64	74.28	63.69	62.54	72.18	63.42	64.03	64.45
403	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	66.37	64.51	86.93	64.75	64.51	74.63	70.60	63.57	64.08	64.96	74.36	63.57	70.03	73.00	63.44	70.64	70.62	86.42	74.08	74.25	54.67	65.00	69.50	64.06	64.93	63.89
420	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	74.29	64.49	63.68	63.94	64.42	74.90	73.54	64.23	73.31	70.90	74.33	74.66	73.71	70.74	63.09	89.19	63.53	70.83	74.83	74.46	73.65	62.94	70.46	64.83	74.41	64.41
421	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	73.67	65.33	64.65	66.86	65.02	74.23	73.83	65.20	81.28	66.34	70.66	74.74	73.03	73.38	63.89	71.96	63.69	72.81	74.83	74.24	63.19	64.99	70.44	65.51	63.65	73.14
422	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	64.24	70.05	63.46	63.05	64.11	87.05	87.23	63.37	87.50	64.14	74.09	74.39	86.28	73.29	63.14	71.00	63.47	73.52	74.47	74.50	63.40	63.80	73.46	63.67	55.40	63.55
423	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	68.86	63.55	64.50	64.11	65.93	75.13	73.69	88.31	73.50	64.57	73.89	74.27	71.74	71.52	64.54	89.73	73.58	70.85	75.05	73.99	63.39	64.14	72.99	64.85	72.64	65.11
440	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	66.08	64.94	64.30	63.99	64.27	75.10	74.67	63.96	70.08	64.62	74.61	74.77	70.54	63.59	63.46	74.12	64.22	73.04	74.39	74.83	63.60	64.26	73.91	64.70	72.08	64.51
441	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	64.77	64.39	63.99	64.88	64.45	74.44	86.04	62.75	74.67	65.04	73.60	71.50	74.10	71.64	63.37	70.55	74.47	72.88	72.21	74.53	63.94	65.94	72.68	65.22	72.89	64.72
442	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	68.72	63.97	63.63	64.57	64.54	75.10	74.06	63.98	87.03	64.40	73.86	64.08	71.38	87.14	63.51	87.37	63.49	73.11	74.59	74.00	55.34	64.74	72.39	63.77	71.22	64.90
443	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	64.42	64.92	74.57	64.54	64.51	74.45	73.54	88.51	64.65	63.62	74.25	74.51	71.08	72.83	63.53	73.46	71.51	72.75	74.14	74.25	72.68	64.39	73.36	64.45	72.13	73.35
460	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	65.18	64.12	64.63	65.48	65.51	63.17	74.60	64.31	65.87	86.36	74.33	74.52	69.52	70.74	63.48	71.01	64.58	73.13	75.34	74.03	63.17	64.19	72.63	64.73	63.53	69.56
461	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	73.95	86.61	64.03	64.52	64.74	63.77	73.87	87.04	64.86	63.73	70.29	74.62	72.67	73.16	63.38	73.20	70.13	73.32	74.13	74.10	63.76	64.36	73.15	64.37	64.74	64.81
462	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	66.19	65.48	64.79	64.81	64.79	74.70	71.00	63.57	69.65	66.09	74.60	64.24	71.89	71.75	62.68	73.31	62.91	72.52	74.42	88.03	64.26	63.79	72.92	65.16	63.69	63.94
463	372	8	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	65.48	64.40	64.51	64.79	64.78	74.83	69.76	62.74	69.83	64.41	74.39	63.14	73.39	70.44	63.87	73.13	63.62	72.79	74.11	74.57	64.17	63.74	73.89	63.92	72.93	64.89
480	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	68.44	65.46	64.78	65.58	64.90	65.23	73.80	87.94	65.87	66.12	72.11	74.66	73.66	74.04	63.93	71.65	74.12	71.61	70.74	74.08	72.09	66.20	72.87	66.15	73.35	65.21
481	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	73.58	64.63	73.93	65.42	64.79	75.15	88.09	64.24	71.06	65.76	88.86	74.82	73.70	73.97	64.12	71.52	74.28	71.25	74.78	75.57	63.83	64.23	72.41	65.00	63.81	64.81
482	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	73.34	63.74	86.13	63.57	64.17	74.90	87.36	64.24	73.33	63.82	74.59	75.03	87.61	62.44	63.77	73.92	73.82	73.50	73.40	73.29	63.71	63.91	73.12	64.31	64.28	64.42
483	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.81	87.43	64.82	64.53	64.84	75.52	73.66	65.52	64.83	65.65	74.37	73.78	73.60	69.60	64.28	73.12	63.84	72.87	74.14	73.74	63.96	64.54	73.59	64.12	73.14	74.13
500	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	65.50	66.00	64.16	64.85	64.83	75.15	86.50	70.05	70.63	64.57	74.86	73.90	73.42	73.27	63.21	73.71	63.83	71.20	74.12	74.27	73.55	64.16	72.65	65.23	64.64	73.66
501	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	64.49	63.97	69.56	65.15	64.53	74.37	74.48	64.07	64.01	63.72	74.14	73.89	73.85	73.32	63.99	87.60	74.44	73.61	71.40	73.73	63.82	63.44	73.16	63.21	73.88	65.51
502	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	65.20	64.75	63.99	64.68	64.78	89.57	73.85	64.37	70.91	69.81	70.10	75.06	73.59	73.56	63.47	71.32	64.33	72.83	73.68	73.96	63.28	63.94	74.91	64.55	72.70	65.54
503	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.04	64.79	73.96	64.17	64.48	89.02	73.79	63.46	64.53	70.91	74.33	74.45	73.92	73.22	63.04	72.61	62.52	72.12	74.09	74.28	63.62	63.51	72.21	73.86	63.51	64.26
520	372	8	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	65.31	64.60	64.78	65.43	65.50	64.32	73.87	64.15	63.17	69.97	73.59	63.85	73.92	73.33	63.33	73.77	73.15	71.33	75.60	74.31	62.91	63.56	73.16	64.53	74.40	65.48
521	372	8	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	65.76	64.53	64.49	64.86	64.91	64.07	73.87	63.78	64.24	70.75	74.59	74.36	73.18	73.56	63.39	70.78	64.77	72.83	73.83	74.54	52.54	64.12	69.33	64.79	71.94	64.80
522	372	8	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	65.62	64.78	65.25	64.95	64.45	74.37	73.89	65.01	64.59	65.08	74.09	63.49	71.23	64.11	63.76	70.42	64.30	73.30	73.57	74.80	64.42	64.96	72.18	64.62	64.98	65.50
523	372	8	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	66.59	64.31	64.91	65.55	65.20	74.62	74.65	63.80	64.35	64.75	74.58	70.46	73.14	73.06	64.11	69.53	63.79	73.06	74.36	75.32	65.13	65.08	72.41	65.43	64.85	64.65
540	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	85.13	64.00	63.99	63.71	64.38	74.63	74.16	64.03	64.67	64.79	74.63	71.30	70.62	73.53	64.76	87.40	63.62	70.39	73.97	74.26	63.99	62.60	72.91	63.80	73.67	73.93
541	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	70.05	64.20	63.75	64.39	63.80	74.88	73.66	64.49	70.66	70.21	74.11	74.49	72.12	70.79	63.93	71.72	70.07	71.20	74.34	71.38	62.54	62.54	73.45	63.82	63.56	70.27
542	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	73.31	63.94	69.19	63.68	63.63	74.36	69.94	88.04	70.62	64.18	74.23	74.27	89.55	73.49	63.37	69.16	74.07	70.25	74.12	74.04	61.95	63.14	72.78	63.70	74.12	63.59
543	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	65.71	65.03	69.50	65.06	65.01	70.62	74.27	64.30	63.79	64.59	71.68	73.05	74.19	74.00	64.32	88.39	74.62	72.73	74.75	74.23	55.47	86.52	73.05	64.60	72.92	73.53
560	372	8	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	64.95	64.73	64.68	69.72	64.53	74.94	73.55	64.04	72.36	63.84	74.11	74.48	73.90	63.71	63.55	73.35	64.27	73.35	75.07	74.25	64.18	63.99	72.88	64.24	64.09	64.78
561	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	73.80	65.29	69.04	65.79	69.83	74.52	74.12	65.24	65.26	65.33	73.86	71.06	70.18	69.85	63.28	70.86	70.95	72.94	74.82	73.70	63.79	65.74	72.40	63.93	89.04	73.16
562	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	64.83	65.22	64.04	64.81	64.76	74.84	74.10	63.72	64.53	65.49	74.61	74.50	71.73	71.08	63.63	72.82	63.70	73.88	73.81	74.02	72.22	64.15	74.13	64.47	64.53	64.20
563	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	69.85	65.42	64.40	65.37	65.08	74.65	73.90	63.51	73.91	64.10	89.14	74.63	71.70	73.30	63.12	72.11	74.39	73.27	75.29	73.85	62.57	64.41	73.12	64.11	64.52	73.86
580	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	65.44	65.18	65.51	65.06	64.62	75.40	74.19	88.93	70.21	70.01	74.12	74.10	87.71	73.13	63.60	65.27	63.63	64.67	73.60	74.78	64.70	63.99	72.64	69.07	64.22	64.47
581	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	85.64	64.95	64.26	64.86	64.94	74.91	74.37	63.97	87.48	65.19	74.84	63.99	73.12	63.85	63.50	73.87	63.07	72.70	74.59	74.39	63.92	63.92	73.16	64.98	73.43	69.79
582	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	66.24	64.38	64.29	64.56	64.21	74.41	73.47	63.74	64.85	64.45	74.12	71.07	73.40	73.02	63.74	73.41	71.28	72.84	73.79	73.79	64.56	63.92	72.40	73.91	64.01	64.63
583	372	8	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	65.09	64.55	65.03	64.35	65.88	64.21	75.53	63.91	64.77	65.43	75.18	63.32	88.89	63.87	63.39	70.92	63.00	70.91	74.52	74.58	63.71	64.19	72.63	64.47	63.47	64.40
600	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	73.81	64.59	63.58	63.02	63.67	74.78	87.54	63.55	64.56	63.67	74.02	73.77	73.87	74.17	62.36	74.89	74.09	73.96	74.82	74.79	63.47	63.13	73.16	73.56	73.17	64.01
601	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	64.47	64.90	64.33	64.64	64.15	75.69	74.08	64.85	70.99	65.37	74.36	73.58	73.97	62.87	62.78	74.10	74.34	72.48	70.72	72.59	63.57	64.58	70.20	65.73	73.55	64.32
602	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	69.13	64.24	69.94	63.94	65.04	74.77	73.64	64.14	64.22	65.68	74.33	74.24	73.88	74.10	63.69	73.12	73.34	72.02	70.89	75.33	54.78	63.84	72.22	64.42	73.83	64.19
603	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	74.02	63.04	63.20	63.58	63.35	87.92	70.76	63.40	69.79	63.79	74.65	71.07	69.59	74.54	62.60	73.48	62.39	73.58	73.93	74.56	69.96	63.79	73.20	63.29	55.77	73.79
620	372	8	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	65.42	64.18	63.24	64.19	64.27	73.94	74.17	64.43	64.14	63.76	74.12	73.58	73.69	73.50	63.07	71.30	64.10	72.71	74.60	73.75	64.26	63.79	72.91	64.27	64.53	63.92
621	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	72.96	64.03	64.65	64.36	64.76	74.81	74.04	63.49	65.17	63.99	74.34	74.58	74.34	73.48	63.53	72.64	63.32	70.98	74.21	73.53	62.83	62.88	73.38	64.47	72.68	64.98
622	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	65.43	64.45	69.73	65.14	64.76	74.78	74.51	63.59	71.03	71.08	72.22	74.04	72.90	70.69	63.26	88.27	64.17	74.58	74.08	75.08	63.49	65.15	73.84	64.03	72.91	64.51
623	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	64.41	64.57	87.95	63.79	70.00	75.04	74.13	87.82	63.78	64.93	87.04	73.60	73.31	73.31	62.53	73.97	70.84	73.83	74.26	87.60	70.00	63.47	72.33	63.49	63.49	64.06
640	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	73.81	64.38	63.76	64.42	64.74	74.78	73.80	63.98	65.39	64.62	74.08	74.04	70.43	73.84	64.63	73.80	62.82	86.66	74.58	75.25	63.19	63.30	63.69	63.56	64.67	63.69
641	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.10	65.40	64.98	64.63	65.73	62.97	71.11	64.35	70.33	65.50	74.83	71.54	73.60	73.08	63.44	71.54	70.76	72.81	74.34	74.52	63.92	64.17	73.16	64.49	64.47	73.80
642	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	69.54	64.36	86.83	64.74	65.01	75.08	74.31	63.45	65.26	65.36	74.82	74.80	73.89	70.07	63.68	74.21	64.33	73.12	74.11	75.12	64.30	64.19	85.30	64.58	70.24	65.25
643	372	8	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	65.74	64.63	64.76	64.90	65.20	63.38	73.76	64.82	64.77	65.17	73.87	74.18	73.09	70.71	63.24	73.25	65.26	73.74	73.85	73.83	64.43	64.41	69.55	64.34	73.89	65.14
660	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	64.55	86.63	63.56	64.83	63.51	74.53	73.81	64.57	70.68	63.57	74.33	75.57	71.54	70.33	62.76	73.91	73.94	71.05	74.30	74.64	73.44	70.49	69.88	63.76	63.14	74.46
661	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	68.55	65.47	64.44	64.98	64.84	74.63	74.08	70.30	70.13	64.65	74.14	74.27	70.16	73.01	64.05	71.76	63.59	89.38	73.83	71.38	73.92	63.39	72.96	63.73	64.21	64.20
662	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	68.71	65.14	69.01	64.54	65.01	75.04	74.71	64.94	64.61	65.55	73.84	74.52	70.86	73.73	64.54	74.75	74.02	73.34	74.87	74.27	63.94	63.69	73.53	73.39	73.16	73.33
663	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	64.73	65.45	88.57	64.44	64.38	74.68	74.09	63.91	63.96	64.11	74.11	75.04	71.77	63.43	63.56	71.30	74.73	73.30	72.67	73.51	74.16	70.56	72.64	63.85	64.31	64.12
680	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	65.43	64.27	68.92	70.44	64.78	76.05	89.41	64.00	64.36	64.73	74.37	71.45	74.22	73.00	63.87	75.19	64.55	70.93	74.23	73.99	63.44	64.45	72.91	64.24	70.45	63.92
681	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	64.60	63.95	63.84	65.02	64.40	74.76	75.81	64.13	73.72	62.42	73.62	74.52	87.28	73.31	62.89	73.21	74.16	73.91	73.86	73.96	63.92	63.69	72.53	63.82	73.29	70.34
682	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	65.40	70.76	64.30	65.01	64.42	75.07	73.95	64.41	64.46	63.95	74.37	74.04	73.12	73.50	63.84	73.39	63.77	73.23	73.79	74.77	63.26	63.53	72.80	64.02	63.44	73.41
683	372	8	0.01	32	0.00001	48	1.000000e-08	1.000000e-08	64.65	64.47	63.86	63.77	64.08	75.29	70.74	63.92	63.59	63.34	71.04	62.82	70.83	71.38	63.86	72.62	64.10	73.27	74.68	73.78	62.65	63.69	73.10	69.36	72.88	69.53

Test Data mAP Results Preview:

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
0	372	8	0.10	24	0.00100	24	0.000000e+00	0.000000e+00	58.51	58.27	60.12	59.54	73.38	76.97	73.61	66.13	66.53	62.40	56.16	57.18	50.60	56.92	59.73	57.90	57.13	58.08	55.28	57.12	58.40	58.81	60.18	57.83	59.44	57.93
1	372	8	0.10	24	0.00100	24	0.000000e+00	1.000000e-08	86.43	58.63	56.91	59.42	59.33	56.41	49.17	65.10	59.32	57.86	57.38	56.76	74.95	56.93	57.36	51.12	57.73	57.44	55.41	49.98	58.39	57.44	58.85	49.17	57.06	57.23
2	372	8	0.10	24	0.00100	24	1.000000e-08	0.000000e+00	79.25	58.67	69.93	58.97	57.46	50.13	72.86	57.36	58.04	57.90	76.05	49.17	75.33	57.47	58.06	75.03	56.12	72.33	56.48	76.45	57.81	49.17	57.56	58.05	57.19	56.65
3	372	8	0.10	24	0.00100	24	1.000000e-08	1.000000e-08	57.71	58.19	57.28	57.31	57.60	50.82	49.84	58.00	75.52	57.45	55.60	57.01	74.78	56.41	55.56	57.35	49.17	57.02	56.61	55.57	61.28	57.40	56.45	56.34	57.16	56.43
20	372	8	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	80.34	59.29	59.05	58.93	59.59	56.90	74.95	58.10	84.47	59.67	57.32	85.82	76.02	57.74	57.80	76.40	57.41	75.53	50.25	56.47	59.33	58.65	51.67	57.38	57.72	57.47
21	372	8	0.10	32	0.00100	24	0.000000e+00	1.000000e-08	53.51	51.33	74.83	56.57	58.51	56.57	87.34	57.03	57.95	49.17	49.99	57.10	75.62	56.08	57.25	76.27	55.81	75.44	87.33	76.90	56.27	56.81	56.93	57.38	56.97	56.50
22	372	8	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	73.78	58.15	74.72	58.27	58.83	76.15	85.60	57.96	75.71	56.58	87.09	56.61	62.42	62.59	57.49	76.31	56.89	63.29	77.38	56.58	56.23	56.86	56.97	56.43	56.45	56.93
23	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	58.22	57.50	58.12	58.46	58.59	76.37	58.98	58.78	57.82	87.52	67.37	57.26	83.45	57.48	58.12	82.84	57.66	80.70	76.33	88.83	67.35	57.13	56.37	56.85	57.85	57.28
40	372	8	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	74.61	58.88	50.49	58.30	74.12	76.17	75.90	57.47	56.71	58.54	75.79	56.63	89.34	75.76	58.67	73.85	57.24	50.15	88.02	56.58	79.85	56.63	56.28	57.58	56.96	56.87
41	372	8	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	74.50	58.26	74.06	58.76	59.11	57.52	88.66	58.42	66.90	58.68	76.20	56.73	75.83	86.61	58.44	75.74	58.39	59.51	57.20	56.88	56.44	57.87	57.59	56.76	58.00	58.13
42	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	73.96	59.04	74.98	59.39	65.85	49.17	82.61	57.87	83.10	58.55	90.88	57.44	57.13	57.84	58.37	76.14	75.66	74.38	77.05	57.50	57.12	57.93	57.93	56.91	67.03	60.49
43	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	74.86	57.77	58.57	58.16	59.39	57.23	74.83	62.22	88.99	62.71	75.67	56.75	75.38	57.38	59.44	86.77	56.92	62.66	56.50	90.31	57.48	56.54	75.39	56.19	57.73	56.37
60	372	8	0.10	24	0.00100	36	0.000000e+00	0.000000e+00	56.47	50.36	49.93	55.71	66.40	52.04	72.97	54.42	62.30	64.00	54.58	50.25	74.66	59.91	55.53	74.93	55.52	50.10	55.12	54.16	73.54	54.53	54.34	55.70	49.17	54.38
61	372	8	0.10	24	0.00100	36	0.000000e+00	1.000000e-08	61.56	59.21	60.02	59.70	59.68	72.52	50.19	57.78	59.18	58.52	58.00	57.63	60.15	73.26	58.84	76.01	62.84	59.40	87.78	56.99	58.79	57.50	58.18	58.09	57.35	56.91
62	372	8	0.10	24	0.00100	36	1.000000e-08	0.000000e+00	74.26	56.14	58.44	62.98	66.51	75.77	73.98	55.68	55.36	53.96	75.18	55.46	74.74	55.28	56.55	54.35	65.19	49.93	54.40	49.53	49.17	56.07	55.95	55.60	55.38	55.72
63	372	8	0.10	24	0.00100	36	1.000000e-08	1.000000e-08	60.55	67.86	71.49	59.30	70.19	57.63	60.33	57.74	51.79	63.15	57.59	55.04	55.52	57.51	63.11	76.07	59.03	58.34	57.18	56.55	58.85	74.57	57.97	58.41	58.77	57.68
80	372	8	0.10	32	0.00100	36	0.000000e+00	0.000000e+00	73.59	57.75	58.14	60.73	58.40	50.27	74.86	56.36	56.87	57.61	55.03	56.76	76.73	56.56	56.23	86.75	55.87	56.93	56.54	55.44	57.01	57.55	57.64	56.48	56.41	55.72
81	372	8	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	74.66	49.17	58.87	63.78	65.69	76.58	75.02	57.24	75.55	86.19	90.08	56.41	76.71	56.50	58.79	57.11	57.06	57.93	57.54	56.21	58.24	58.07	56.70	57.18	57.47	57.22
82	372	8	0.10	32	0.00100	36	1.000000e-08	0.000000e+00	49.17	59.04	59.25	59.12	57.81	57.35	74.87	57.64	57.51	57.12	57.12	56.69	75.48	57.26	57.60	56.94	56.86	75.62	56.82	89.28	67.62	57.55	56.85	57.78	56.44	57.18
83	372	8	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	52.21	57.48	64.27	58.17	58.12	57.99	73.27	57.83	58.25	58.93	57.40	57.53	75.69	76.71	57.59	89.51	85.40	75.99	76.35	49.50	57.17	58.05	58.39	57.36	57.65	57.14
100	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	74.76	57.71	57.82	60.73	58.48	76.63	73.21	56.75	51.41	88.69	76.96	56.95	76.59	89.25	56.28	77.09	57.01	89.39	75.92	55.99	56.81	57.55	56.45	56.44	56.76	56.31
101	372	8	0.10	48	0.00100	36	0.000000e+00	1.000000e-08	57.07	58.76	58.08	58.04	58.77	76.06	55.65	57.29	57.73	86.43	57.20	56.51	75.75	58.73	57.04	49.17	56.21	58.06	56.49	49.17	57.37	55.96	56.58	67.54	56.79	56.82
102	372	8	0.10	48	0.00100	36	1.000000e-08	0.000000e+00	74.50	49.17	86.34	57.80	58.38	76.81	49.17	87.42	64.75	63.60	76.90	56.19	75.90	57.22	57.26	49.17	56.66	76.58	50.81	56.45	56.54	57.94	56.20	56.79	56.11	57.18
103	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	74.48	58.38	75.26	59.12	74.51	76.15	87.18	57.66	89.33	50.27	57.20	56.88	87.78	58.25	57.70	88.17	58.24	62.23	57.03	56.40	56.19	70.14	56.31	49.17	57.31	56.93
120	372	8	0.10	24	0.00100	48	0.000000e+00	0.000000e+00	60.18	59.78	58.54	74.09	57.49	55.92	74.69	58.20	64.14	57.05	63.91	49.17	57.48	50.71	57.99	51.01	70.18	55.60	49.17	56.12	58.80	59.42	57.92	57.65	57.56	58.09
121	372	8	0.10	24	0.00100	48	0.000000e+00	1.000000e-08	73.55	70.50	50.94	57.24	57.36	54.81	74.73	64.65	56.14	56.65	50.02	76.25	74.69	55.24	54.25	74.72	55.46	55.58	56.14	86.82	57.80	57.25	56.50	56.37	56.62	56.82
122	372	8	0.10	24	0.00100	48	1.000000e-08	0.000000e+00	72.78	57.61	49.17	66.66	57.60	73.18	73.10	55.85	57.62	56.52	54.61	56.33	51.31	57.21	49.17	66.02	55.90	55.74	54.73	75.09	57.37	56.63	56.78	56.86	56.29	56.51
123	372	8	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	73.84	49.17	58.72	59.73	58.91	86.29	74.37	74.31	59.53	57.97	75.85	57.09	75.80	56.80	57.80	53.88	57.10	51.43	57.02	55.99	69.53	58.17	58.31	57.07	57.09	57.45
140	372	8	0.10	32	0.00100	48	0.000000e+00	0.000000e+00	57.91	65.70	60.38	58.88	58.74	56.86	72.90	56.76	56.28	57.81	75.14	56.07	75.87	61.91	56.47	84.91	56.02	56.25	76.96	54.96	56.55	57.12	56.07	56.65	57.75	55.98
141	372	8	0.10	32	0.00100	48	0.000000e+00	1.000000e-08	49.17	58.90	50.46	59.87	73.76	76.82	60.01	58.69	74.79	59.82	90.82	56.82	74.73	57.98	59.37	59.11	60.36	54.95	56.96	56.63	56.74	58.57	57.16	64.16	57.69	57.55
142	372	8	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	73.99	58.26	58.24	58.66	59.29	75.77	73.20	57.42	57.61	74.62	58.13	56.66	75.84	57.39	57.61	76.21	57.28	75.61	76.59	87.01	57.69	57.67	57.22	56.83	57.60	56.83
143	372	8	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	60.53	58.35	59.34	58.34	65.12	76.21	58.53	57.83	59.34	51.32	76.53	65.28	75.19	56.67	58.08	89.32	57.71	59.01	76.60	56.64	57.59	58.16	57.37	57.36	57.26	57.49
160	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	84.75	60.23	73.98	59.25	59.58	76.24	49.17	58.77	59.34	59.28	76.26	57.50	75.34	58.27	75.15	88.18	57.69	91.72	76.00	57.29	58.15	58.11	57.28	57.39	57.76	58.50
161	372	8	0.10	48	0.00100	48	0.000000e+00	1.000000e-08	56.80	58.51	74.92	57.77	58.99	50.01	74.79	57.94	57.73	58.53	92.60	56.99	87.97	57.39	56.83	75.20	57.50	89.04	57.48	56.76	57.00	55.79	56.18	57.34	56.39	57.54
162	372	8	0.10	48	0.00100	48	1.000000e-08	0.000000e+00	84.45	58.80	59.55	49.17	59.40	75.51	75.16	59.64	55.68	49.17	57.45	57.29	74.79	57.36	58.31	88.38	58.94	78.72	76.25	56.55	56.63	56.10	56.76	57.27	56.86	56.52
163	372	8	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	74.45	75.22	57.91	69.97	56.79	76.17	51.08	57.40	88.87	49.17	76.30	57.36	76.05	57.53	57.23	88.99	57.61	56.66	76.60	57.31	56.65	57.43	56.99	56.19	56.77	56.27
180	372	8	0.10	24	0.00001	24	0.000000e+00	0.000000e+00	68.10	59.55	59.19	49.17	68.83	56.01	58.58	57.92	65.82	59.55	57.50	55.93	75.36	62.56	58.76	51.21	67.31	57.52	54.96	54.33	58.93	59.14	58.16	58.15	58.49	59.02
181	372	8	0.10	24	0.00001	24	0.000000e+00	1.000000e-08	79.30	59.23	59.90	59.93	59.95	58.51	50.96	58.27	59.08	60.12	57.07	57.43	70.48	82.26	59.34	51.18	58.55	51.25	57.13	56.36	60.95	58.51	57.64	58.32	57.56	57.06
182	372	8	0.10	24	0.00001	24	1.000000e-08	0.000000e+00	60.22	59.59	50.50	60.80	60.53	57.52	73.28	59.01	60.56	66.00	51.51	57.49	52.77	58.03	58.99	58.87	64.05	69.01	56.63	57.34	58.17	62.34	58.25	65.50	57.87	57.39
183	372	8	0.10	24	0.00001	24	1.000000e-08	1.000000e-08	72.68	56.86	74.19	58.03	58.31	57.83	73.20	56.80	74.93	57.25	50.25	56.59	75.88	55.89	55.58	75.90	50.48	74.50	55.82	55.06	57.08	56.94	56.52	57.18	57.25	55.96
200	372	8	0.10	32	0.00001	24	0.000000e+00	0.000000e+00	73.82	58.45	58.98	60.87	58.64	55.89	50.59	56.99	67.65	58.70	50.05	55.87	76.19	56.99	57.75	58.38	56.66	76.12	86.20	88.94	57.71	58.05	50.74	57.00	66.76	57.49
201	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	71.81	59.25	63.19	58.23	59.25	57.14	83.18	57.52	51.91	86.58	87.50	89.32	75.80	57.16	57.55	75.72	49.66	57.31	88.68	56.48	57.44	58.41	56.88	56.40	57.32	57.18
202	372	8	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	74.14	58.69	85.84	58.18	59.34	76.45	75.04	57.49	75.64	58.80	57.29	57.36	75.72	87.68	57.49	76.54	57.68	57.11	56.76	56.60	57.40	57.85	56.70	56.83	57.33	57.68
203	372	8	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	86.47	57.32	59.01	59.26	59.09	76.25	75.06	57.05	76.05	58.40	76.07	57.26	75.04	58.03	58.55	76.01	57.67	58.25	77.03	57.04	58.38	58.35	56.93	57.53	57.98	56.91
220	372	8	0.10	48	0.00001	24	0.000000e+00	0.000000e+00	75.15	58.30	58.60	56.84	58.34	57.12	73.06	57.55	57.00	57.09	77.54	88.77	87.02	76.87	57.11	75.99	56.72	76.03	55.87	56.18	56.39	56.21	56.61	56.74	57.62	55.46
221	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	74.86	58.38	58.51	58.35	60.32	57.58	74.77	65.30	86.29	57.82	57.58	56.79	75.15	84.31	57.43	88.58	66.37	75.57	76.51	90.76	56.47	56.13	56.57	56.81	55.77	57.47
222	372	8	0.10	48	0.00001	24	1.000000e-08	0.000000e+00	74.48	63.90	58.35	58.20	74.16	92.46	74.95	57.30	57.77	58.04	76.76	57.50	75.82	55.61	49.55	76.42	56.74	64.32	49.75	56.32	55.85	56.93	56.95	56.92	58.23	60.08
223	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	73.96	59.25	85.90	58.23	59.02	76.79	74.72	57.48	86.52	53.53	57.61	57.37	56.31	57.30	57.43	77.16	57.05	75.73	90.20	88.62	55.86	57.45	56.68	56.35	56.38	56.92
240	372	8	0.10	24	0.00001	36	0.000000e+00	0.000000e+00	58.68	57.91	58.04	70.57	72.83	51.06	72.69	57.11	73.85	58.56	49.94	56.17	75.92	50.41	56.78	64.08	57.68	58.65	56.75	55.82	57.78	58.41	57.58	57.63	57.34	57.58
241	372	8	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	60.57	58.64	59.44	57.91	59.15	57.70	74.44	57.47	74.48	58.66	57.26	56.78	75.30	57.93	58.28	75.54	56.67	67.21	76.95	56.89	75.21	58.35	57.97	57.97	57.19	57.71
242	372	8	0.10	24	0.00001	36	1.000000e-08	0.000000e+00	50.58	57.57	56.39	55.59	56.50	54.69	51.17	56.13	55.65	50.54	50.87	55.35	56.63	64.04	54.38	50.07	55.24	64.33	77.10	55.89	56.65	57.56	57.60	55.35	57.71	56.44
243	372	8	0.10	24	0.00001	36	1.000000e-08	1.000000e-08	67.16	64.21	59.10	58.79	59.01	50.25	50.50	58.52	59.59	62.59	76.25	50.64	56.90	57.05	58.85	73.60	58.02	50.66	76.26	56.98	57.78	58.15	56.94	58.30	66.27	58.15
260	372	8	0.10	32	0.00001	36	0.000000e+00	0.000000e+00	50.10	57.92	56.53	56.87	51.95	56.91	74.02	56.34	81.06	67.23	56.76	58.09	56.86	54.90	55.02	57.80	55.37	67.20	76.83	55.63	57.10	56.09	56.17	56.31	56.28	56.30
261	372	8	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	74.53	57.94	58.28	58.20	75.22	57.52	75.28	56.99	83.24	49.15	56.85	76.90	76.11	57.27	57.90	76.38	57.26	56.65	77.65	76.36	57.27	57.00	56.62	56.70	56.88	81.16
262	372	8	0.10	32	0.00001	36	1.000000e-08	0.000000e+00	74.09	58.84	49.78	58.23	58.60	76.18	50.82	57.20	58.35	57.31	74.78	56.96	73.09	56.60	56.74	50.68	65.43	67.34	91.70	56.89	57.47	65.05	57.15	56.57	57.33	57.10
263	372	8	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	74.16	58.76	50.98	58.63	73.64	50.00	86.20	58.87	62.98	80.39	57.46	57.88	66.15	61.09	58.00	76.20	85.88	75.45	58.03	56.60	58.53	57.12	57.75	57.62	56.93	58.11
280	372	8	0.10	48	0.00001	36	0.000000e+00	0.000000e+00	75.33	58.39	73.94	58.26	67.63	57.47	75.49	57.60	57.29	58.44	56.86	56.48	75.72	49.88	57.70	74.86	64.87	57.77	57.20	56.30	56.87	57.78	55.58	57.24	57.15	56.11
281	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	74.92	58.90	52.31	58.14	59.44	56.52	74.92	56.86	83.52	57.10	76.33	57.26	76.48	56.08	57.17	87.62	57.51	64.14	76.60	88.25	57.47	56.68	55.82	55.82	56.78	56.93
282	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	55.02	58.19	64.99	58.76	50.63	50.42	87.66	57.54	64.27	58.82	89.28	56.88	75.24	89.48	58.00	86.01	57.07	63.92	90.98	56.76	57.78	56.50	57.30	57.26	56.63	57.18
283	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	54.09	58.26	74.93	57.56	75.44	76.39	75.61	57.36	75.87	58.99	77.70	76.90	76.17	57.64	58.00	87.76	56.59	90.85	56.76	56.56	71.18	56.60	75.74	56.26	56.45	56.30
300	372	8	0.10	24	0.00001	48	0.000000e+00	0.000000e+00	64.42	58.51	58.32	58.96	59.11	49.17	73.20	57.66	58.15	57.59	57.35	55.64	50.65	57.07	58.21	51.10	56.82	75.32	56.59	71.95	59.54	60.96	75.20	61.57	57.86	57.63
301	372	8	0.10	24	0.00001	48	0.000000e+00	1.000000e-08	72.50	58.94	66.06	58.02	58.36	57.24	72.79	56.99	57.53	60.72	87.54	54.09	75.94	56.91	56.42	56.41	56.80	84.09	56.66	53.57	70.78	65.30	57.96	56.82	56.46	61.15
302	372	8	0.10	24	0.00001	48	1.000000e-08	0.000000e+00	50.61	64.82	57.68	56.36	57.95	85.05	73.75	64.45	74.05	50.27	56.60	54.55	57.95	55.21	57.92	60.41	57.22	57.30	54.55	55.09	58.23	57.12	56.33	56.15	56.85	58.26
303	372	8	0.10	24	0.00001	48	1.000000e-08	1.000000e-08	55.77	57.64	57.49	57.33	56.82	89.54	84.25	57.79	56.48	57.57	76.27	85.47	83.43	56.38	56.42	86.24	56.39	56.54	76.90	56.95	55.75	56.31	56.44	55.26	55.46	56.51
320	372	8	0.10	32	0.00001	48	0.000000e+00	0.000000e+00	59.74	59.50	49.97	58.84	58.02	57.26	56.02	57.32	49.17	58.51	49.17	54.91	83.24	57.34	57.25	76.64	58.58	57.76	76.35	56.62	58.29	56.02	57.06	57.13	56.92	56.93
321	372	8	0.10	32	0.00001	48	0.000000e+00	1.000000e-08	74.16	58.14	58.76	58.11	58.54	76.28	74.13	57.52	75.02	75.11	76.33	56.73	85.76	57.28	57.72	57.82	56.57	75.39	55.04	56.74	56.95	57.78	56.93	55.94	57.41	62.13
322	372	8	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	69.17	58.51	74.28	58.35	58.96	57.19	83.15	58.00	81.69	59.38	57.29	57.68	75.97	57.39	57.58	57.40	56.89	75.35	87.02	85.45	56.78	56.89	56.72	56.18	56.76	56.86
323	372	8	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	74.51	58.92	74.78	57.90	58.13	76.06	90.46	57.77	56.43	57.98	76.75	56.64	75.88	57.21	57.70	83.58	83.92	57.14	56.63	56.36	57.52	56.72	56.39	56.43	57.78	56.58
340	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	59.50	58.60	81.92	58.26	58.33	76.09	86.18	57.66	81.27	58.02	76.14	57.50	76.52	57.84	57.56	76.71	58.35	75.57	75.92	56.53	57.95	57.24	57.01	57.74	87.20	56.68
341	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	59.82	58.51	75.03	58.45	74.41	57.71	74.15	58.10	87.40	57.39	91.32	57.31	75.82	82.72	57.73	68.77	56.98	84.57	76.84	56.44	57.04	57.08	57.44	56.51	57.63	56.93
342	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.98	58.79	65.05	59.11	74.40	50.26	76.00	64.33	58.61	59.09	76.16	90.39	86.00	58.01	57.96	82.49	56.98	86.52	56.71	56.76	57.89	71.72	57.07	57.43	57.84	57.00
343	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	74.01	58.54	50.55	69.49	59.12	50.44	75.19	57.80	74.80	58.51	50.25	57.75	75.16	87.81	57.64	75.39	87.55	87.07	76.32	56.38	56.76	56.98	56.92	56.93	56.62	70.58
360	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	74.55	58.26	59.14	58.66	58.00	75.57	74.88	68.59	58.14	58.80	90.38	75.50	74.88	88.42	60.37	68.85	68.68	73.70	75.17	74.87	56.55	56.83	75.74	75.89	76.27	56.68
361	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	75.18	57.97	58.16	58.40	57.97	68.88	68.88	67.93	76.25	58.03	75.77	76.05	68.70	74.76	58.25	69.32	74.53	75.77	75.60	75.07	56.54	56.55	69.04	56.94	68.02	56.87
362	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	88.82	59.21	59.34	58.37	58.02	74.66	69.45	74.19	73.95	57.72	67.64	75.60	74.25	74.33	58.42	74.06	74.93	69.04	75.63	70.02	58.32	57.44	75.14	58.53	58.29	57.54
363	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	75.43	57.93	88.10	57.33	57.72	76.21	75.65	58.40	69.25	68.26	76.11	75.72	74.46	68.90	58.20	74.82	58.22	73.58	75.65	75.17	56.44	57.07	75.98	69.14	76.66	56.77
380	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	69.85	58.79	58.48	58.77	58.35	67.44	74.21	58.89	59.05	57.97	75.16	75.41	67.60	58.49	57.58	74.39	75.05	73.69	75.96	68.50	91.87	58.00	74.64	59.22	74.84	57.39
381	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	58.72	58.40	68.62	58.59	58.45	75.12	75.03	58.46	57.03	89.57	70.42	75.22	89.51	74.11	58.10	73.49	58.39	74.31	75.57	76.42	75.28	58.26	75.89	56.97	76.19	68.44
382	372	8	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	73.64	57.53	58.46	58.61	58.76	69.29	74.04	58.14	58.24	58.05	74.61	58.84	68.37	74.09	59.75	74.65	58.71	69.43	76.25	74.92	57.24	58.06	75.96	58.07	57.19	76.02
383	372	8	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	69.27	59.01	58.37	60.70	58.50	75.97	75.10	56.98	57.88	58.05	75.84	68.78	74.77	74.07	58.80	73.87	73.19	74.07	75.58	70.03	58.25	56.69	75.77	58.23	57.29	56.91
400	372	8	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	58.81	58.20	58.17	58.97	59.10	76.65	74.14	57.79	58.54	57.80	74.66	74.64	75.00	57.54	58.51	75.09	58.06	68.77	75.35	69.54	45.32	57.93	76.14	57.23	75.47	69.01
401	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	58.79	58.54	68.82	60.03	60.49	74.60	68.59	58.84	58.24	58.62	75.61	75.44	89.48	59.07	58.50	73.53	59.14	68.91	74.69	75.42	91.11	59.30	76.29	58.08	58.48	58.99
402	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	58.74	57.18	57.98	58.50	58.53	75.86	74.31	87.09	57.63	57.79	75.31	75.13	89.14	74.58	58.83	71.36	59.09	71.96	75.20	74.43	56.98	57.84	75.18	57.72	57.16	58.06
403	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	59.74	57.96	92.21	58.44	58.79	75.05	68.83	56.83	58.35	58.41	76.15	56.78	67.53	74.23	57.44	67.70	69.76	89.08	75.15	75.11	46.88	57.82	70.14	57.29	56.98	57.32
420	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	75.37	58.60	57.71	57.79	58.82	74.57	74.83	58.96	74.38	69.41	75.13	74.78	74.07	68.48	57.92	91.07	57.80	69.23	75.77	75.83	75.19	57.01	69.40	56.67	76.17	56.94
421	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	74.57	60.97	60.84	61.24	60.20	74.60	74.76	60.45	77.75	59.39	68.87	76.52	73.74	73.93	60.41	68.75	59.09	73.35	74.82	75.01	56.78	58.45	68.83	58.72	57.27	75.64
422	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	58.42	67.98	57.41	57.06	57.60	91.19	90.28	57.67	90.55	57.47	75.88	76.00	90.11	74.74	58.71	68.02	57.11	74.82	75.43	74.75	56.79	56.73	75.61	57.20	51.76	56.73
423	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	69.83	57.97	57.72	58.61	60.69	75.94	74.29	90.52	74.60	58.28	76.15	75.95	69.41	68.74	60.04	88.93	74.36	68.36	77.12	74.62	56.29	57.85	75.36	58.98	75.67	57.88
440	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	58.71	58.30	58.09	57.59	57.71	75.66	74.34	58.09	68.36	58.65	74.91	75.07	68.03	58.23	58.24	73.38	58.75	73.80	75.19	74.91	56.41	57.95	76.51	57.82	70.23	58.34
441	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	59.06	58.98	58.25	57.92	58.80	75.78	86.72	57.08	74.33	58.18	74.87	67.77	74.89	69.09	58.96	69.00	73.83	73.85	70.73	75.36	57.50	59.13	74.68	60.06	75.43	57.64
442	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	69.36	58.34	57.22	57.59	58.94	75.80	74.09	57.26	91.27	58.09	75.63	57.97	67.55	91.12	58.37	90.14	57.35	71.85	75.47	75.31	47.36	57.57	75.29	56.75	68.98	57.75
443	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	58.99	58.74	75.06	57.80	58.51	74.45	73.12	90.53	58.18	57.71	76.06	76.13	67.43	75.55	58.56	74.33	69.50	74.28	74.71	75.17	75.02	58.36	75.42	56.92	69.42	75.76
460	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	58.71	57.68	58.63	58.66	59.44	57.98	73.45	58.09	59.70	90.41	75.30	75.42	68.69	69.00	58.02	68.07	59.13	73.86	76.36	75.65	57.07	57.75	75.16	57.87	58.13	68.57
461	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	74.23	87.93	58.70	58.54	58.94	57.92	74.10	89.63	58.52	57.40	69.93	74.69	75.16	74.95	57.74	72.79	68.83	73.42	74.81	75.39	57.87	61.34	76.18	58.29	57.80	59.91
462	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	58.76	59.93	60.39	58.73	59.06	73.99	68.26	58.44	69.55	58.83	75.47	59.00	67.99	69.47	58.04	75.34	58.89	72.77	76.30	91.06	58.13	56.70	75.29	57.97	58.69	58.06
463	372	8	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	58.47	57.77	58.83	59.01	58.76	75.46	70.05	58.54	69.24	58.16	76.38	57.72	75.15	69.36	58.67	74.37	58.04	74.41	75.65	75.21	58.16	58.67	76.52	56.76	74.93	57.88
480	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	67.76	58.81	59.59	58.94	60.04	59.97	74.09	89.43	58.99	59.22	69.15	75.52	73.91	74.47	58.87	68.22	73.81	68.78	67.94	75.03	74.63	61.02	74.90	61.50	75.94	59.80
481	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	74.87	59.09	75.42	59.07	58.13	74.76	90.21	57.60	69.49	58.80	91.09	76.05	74.91	74.07	58.75	67.52	75.19	69.99	76.17	75.52	57.67	57.68	75.91	57.39	57.01	57.11
482	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	74.42	57.62	89.58	56.73	58.08	75.59	90.86	57.66	74.92	57.02	76.06	75.41	89.26	56.89	59.28	74.74	74.46	75.06	74.35	75.30	57.08	56.88	75.55	56.86	56.22	56.30
483	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.64	85.96	59.63	58.22	59.02	74.69	74.11	59.98	59.13	59.18	75.17	75.08	75.43	68.42	58.74	73.70	58.37	73.95	74.57	74.86	57.20	57.57	75.22	58.61	75.34	76.00
500	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	58.62	59.55	59.43	59.42	59.38	74.78	88.80	67.89	68.83	58.61	75.19	74.82	73.90	73.75	58.71	73.81	57.80	68.64	74.15	75.42	74.47	58.25	75.92	57.64	59.19	75.97
501	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	58.74	58.56	68.55	58.06	58.70	75.73	74.24	58.51	56.90	58.08	75.36	75.42	75.44	75.10	57.84	89.89	74.56	73.40	69.32	74.53	57.75	57.50	75.27	56.83	75.75	57.29
502	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	58.71	58.58	58.45	57.63	58.51	91.40	74.09	58.49	69.13	68.58	69.80	76.53	74.93	74.84	57.40	69.09	58.21	74.28	75.63	73.23	57.64	57.41	76.97	58.26	74.96	57.87
503	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.88	58.19	74.82	57.96	59.25	91.70	73.19	57.60	57.64	68.18	75.13	75.43	73.97	75.44	58.74	73.41	56.85	73.15	75.13	75.30	56.56	57.13	75.82	76.14	56.83	57.47
520	372	8	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	58.79	58.49	59.13	59.80	59.81	59.02	74.39	59.05	57.84	70.13	75.37	57.69	74.37	73.38	59.31	72.60	74.58	68.21	74.63	75.38	57.19	58.06	75.36	58.53	74.92	58.56
521	372	8	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	59.06	58.61	58.74	59.03	60.13	58.06	74.50	56.42	58.22	68.77	75.95	75.29	74.04	75.93	58.26	68.28	59.06	74.77	75.92	75.62	44.63	57.48	69.25	57.79	75.00	59.50
522	372	8	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	58.36	58.96	59.78	59.07	59.06	75.13	74.26	59.56	59.84	59.37	75.55	58.54	67.33	57.81	59.80	67.75	58.47	74.24	74.91	75.06	58.22	59.33	74.74	57.43	58.05	58.36
523	372	8	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	58.71	60.30	58.56	59.76	59.64	76.03	74.14	58.90	59.18	58.78	75.61	70.09	74.61	74.93	59.24	68.49	58.44	72.94	75.20	75.37	58.54	59.88	75.76	58.14	60.86	58.21
540	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	89.87	57.19	57.80	57.89	58.04	75.37	75.47	57.66	58.41	58.15	75.42	69.03	67.85	74.30	59.76	87.44	57.61	68.26	76.30	74.44	57.19	56.08	75.81	57.92	75.57	75.15
541	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	66.99	57.95	57.97	57.99	58.45	75.27	73.90	57.82	68.69	68.57	75.89	75.47	68.85	68.76	59.19	68.75	69.02	68.50	75.24	69.12	56.15	56.11	76.39	56.94	57.55	68.78
542	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	74.44	57.16	67.44	56.97	57.58	75.05	68.88	90.24	66.74	58.01	75.39	75.61	89.38	74.53	57.96	67.64	73.67	68.75	76.06	75.18	56.46	56.42	75.99	56.58	76.41	56.50
543	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	58.98	58.73	67.71	58.92	59.32	69.31	74.13	59.53	57.91	59.45	70.18	75.12	75.74	74.78	58.40	90.65	73.99	73.83	75.13	74.59	46.73	90.06	74.36	57.51	74.15	75.94
560	372	8	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	59.11	58.73	59.22	70.27	59.19	75.77	74.68	59.04	74.89	59.70	76.14	75.36	74.93	58.55	59.03	74.37	58.58	74.04	76.06	75.11	58.12	56.98	73.68	57.14	56.98	57.10
561	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	74.31	59.72	68.94	59.57	68.11	75.26	74.33	60.15	60.08	58.74	74.83	68.12	68.62	68.62	58.74	67.09	69.29	73.65	75.29	75.11	58.20	58.65	74.60	59.23	91.65	75.17
562	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	58.20	59.67	58.46	58.19	58.70	74.48	74.30	58.57	58.19	59.24	75.34	75.66	68.27	69.13	58.35	74.63	58.44	74.53	74.44	74.97	74.75	57.28	75.89	57.30	57.38	57.98
563	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	70.92	58.50	57.82	58.98	59.58	75.33	74.16	58.03	74.51	58.20	90.39	74.98	68.50	74.31	57.43	68.18	74.89	74.16	76.03	74.75	56.94	57.95	75.48	57.99	59.87	74.67
580	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	58.68	59.12	59.82	58.82	59.07	76.34	74.53	91.43	68.52	68.34	75.62	75.09	88.54	73.74	59.08	58.89	59.04	59.23	75.40	74.58	58.22	57.59	75.41	66.74	57.51	57.90
581	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	90.46	58.81	59.19	59.11	59.16	75.41	73.88	58.43	88.79	58.51	75.46	58.86	74.32	58.27	59.00	74.15	58.55	73.63	74.74	75.05	57.50	58.00	75.33	57.78	75.38	68.10
582	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	59.25	58.45	59.19	57.95	58.23	75.18	74.23	57.51	57.70	58.09	74.69	70.32	74.43	74.88	57.74	74.24	69.77	74.64	74.92	75.37	57.80	57.75	76.24	75.39	57.74	57.32
583	372	8	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	58.65	58.91	58.70	58.70	61.91	57.62	75.95	57.97	58.02	57.61	76.34	57.81	89.05	58.71	58.19	67.97	57.18	68.61	75.11	75.62	57.12	59.14	75.66	57.70	57.01	58.53
600	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	74.68	59.35	57.15	57.55	57.78	74.94	91.32	57.83	58.50	57.85	74.59	75.73	74.11	74.97	57.38	73.78	74.85	74.84	75.36	75.76	57.03	56.51	75.59	76.05	75.78	56.92
601	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	58.64	58.94	59.01	58.17	58.81	76.42	75.36	58.90	69.49	58.62	75.65	74.91	73.61	58.58	57.97	73.16	74.50	70.42	69.03	69.86	57.38	57.45	69.37	58.31	75.27	56.77
602	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	69.98	58.46	68.88	57.50	58.86	75.07	74.03	58.49	58.21	58.05	74.64	75.65	74.58	74.62	58.03	75.03	75.51	68.37	69.40	76.23	46.31	56.89	74.32	57.10	75.08	56.98
603	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	74.84	57.26	57.24	56.99	57.03	90.30	68.50	57.50	69.94	56.32	76.46	69.58	68.72	74.77	57.65	73.67	56.95	74.36	76.50	76.28	68.12	56.79	75.17	56.68	49.92	76.02
620	372	8	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	58.04	57.78	57.17	57.71	57.77	74.90	74.98	58.24	57.93	57.54	75.40	75.06	72.99	74.28	57.31	68.84	58.65	74.95	75.72	75.36	57.41	56.77	75.47	57.34	57.71	57.01
621	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	74.54	57.78	57.99	58.68	58.51	75.36	75.12	58.98	58.49	58.55	75.87	74.95	74.95	73.91	57.77	69.16	57.25	68.27	73.35	75.39	57.08	56.45	75.30	57.72	76.01	57.08
622	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	58.45	58.27	68.42	59.21	57.97	74.99	75.08	57.59	68.80	69.80	69.51	75.79	74.18	68.20	57.28	87.32	58.94	73.79	74.67	75.52	57.03	58.49	75.86	57.41	76.00	57.35
623	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	58.18	58.42	91.98	57.06	68.91	74.41	73.84	90.31	58.18	57.48	93.18	74.15	73.99	74.59	56.89	75.16	68.94	73.17	75.50	89.45	70.20	57.50	75.11	56.51	57.19	57.13
640	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	74.19	58.31	58.76	56.99	59.50	76.67	74.30	58.73	59.12	58.15	74.87	75.89	68.37	74.29	60.18	73.26	58.29	89.91	75.89	75.08	57.50	56.03	57.30	57.11	57.48	57.71
641	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.24	59.81	59.21	58.32	61.54	57.26	68.62	59.23	69.27	57.98	75.63	69.57	73.80	73.02	60.03	67.25	69.76	74.16	75.22	75.16	57.97	57.97	75.60	58.54	57.89	76.11
642	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	70.87	58.63	91.63	59.26	58.94	75.27	73.61	58.52	60.50	60.45	76.52	75.17	73.96	69.71	59.31	72.68	58.06	73.74	75.42	74.43	58.43	57.25	90.34	59.43	69.45	59.08
643	372	8	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	59.22	58.50	58.45	58.42	59.01	56.90	73.53	58.53	58.52	58.57	75.16	74.34	73.04	69.68	58.43	72.72	59.22	74.31	75.95	75.10	57.45	58.91	68.52	58.85	75.69	57.11
660	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	58.34	91.10	58.11	57.58	57.98	75.54	74.71	58.84	68.04	58.28	76.54	76.81	68.50	68.70	57.52	74.67	74.63	69.13	75.89	75.68	76.01	68.09	69.78	56.55	55.71	76.49
661	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	67.30	60.29	58.98	58.22	58.76	75.25	74.80	67.95	68.77	58.20	74.84	74.68	68.32	74.29	58.50	68.84	57.79	93.55	75.13	69.93	75.55	56.89	74.48	57.15	58.09	56.64
662	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	69.33	58.48	68.50	58.68	60.00	76.03	75.43	60.39	60.34	59.32	75.88	75.66	68.51	74.59	59.97	74.50	74.01	73.92	75.72	74.93	57.75	57.23	75.40	76.21	75.55	74.59
663	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	58.50	59.62	90.65	57.59	58.04	75.85	75.05	58.25	58.19	58.26	76.12	75.32	68.98	58.34	58.19	68.79	75.28	74.33	70.13	75.65	76.11	68.35	75.43	58.07	57.01	57.67
680	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	58.96	58.47	69.01	68.47	58.85	76.65	91.16	59.07	58.27	58.77	75.42	69.50	74.17	73.71	58.87	75.50	58.52	68.37	75.84	74.58	58.24	59.34	75.72	57.88	69.17	56.98
681	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	58.34	58.75	58.66	58.34	59.27	74.05	76.66	57.89	74.93	58.17	74.68	75.15	89.19	74.33	57.37	73.39	74.89	74.53	74.69	74.50	57.50	57.19	75.61	57.34	75.92	68.37
682	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	58.99	68.98	58.66	59.39	58.56	76.94	75.03	57.27	58.25	57.99	75.11	75.11	72.17	74.31	58.09	73.99	57.47	74.41	75.57	74.74	57.41	58.40	73.87	57.03	56.58	75.81
683	372	8	0.01	32	0.00001	48	1.000000e-08	1.000000e-08	57.47	58.21	57.88	57.69	58.44	75.57	68.46	58.13	57.09	57.42	69.75	57.99	68.08	69.38	57.91	68.25	57.86	74.34	74.33	75.46	56.83	57.59	75.42	68.10	75.13	68.27

Model performance on validation data (T-test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues = []
pvalues_real = []

for _,index in enumerate(dt_valid_sub.index):
  _, p_value = stats.ttest_ind(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')
  pvalues_real.append(p_value)
  pvalues.append((p_value >= 0.05)*1)

  

dt_valid_sub['pvalues'] = pvalues_real
dt_valid_sub['sig'] = pvalues


dt_valid_sub1 = dt_valid_sub.query('sig == 1')


max_indexx = dt_valid_sub1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
540	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	85.13	64.00	63.99	63.71	64.38	74.63	74.16	64.03	64.67	64.79	74.63	71.30	70.62	73.53	64.76	87.40	63.62	70.39	73.97	74.26	63.99	62.60	72.91	63.80	73.67	73.93
541	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	70.05	64.20	63.75	64.39	63.80	74.88	73.66	64.49	70.66	70.21	74.11	74.49	72.12	70.79	63.93	71.72	70.07	71.20	74.34	71.38	62.54	62.54	73.45	63.82	63.56	70.27
542	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	73.31	63.94	69.19	63.68	63.63	74.36	69.94	88.04	70.62	64.18	74.23	74.27	89.55	73.49	63.37	69.16	74.07	70.25	74.12	74.04	61.95	63.14	72.78	63.70	74.12	63.59
543	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	65.71	65.03	69.50	65.06	65.01	70.62	74.27	64.30	63.79	64.59	71.68	73.05	74.19	74.00	64.32	88.39	74.62	72.73	74.75	74.23	55.47	86.52	73.05	64.60	72.92	73.53
600	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	73.81	64.59	63.58	63.02	63.67	74.78	87.54	63.55	64.56	63.67	74.02	73.77	73.87	74.17	62.36	74.89	74.09	73.96	74.82	74.79	63.47	63.13	73.16	73.56	73.17	64.01
601	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	64.47	64.90	64.33	64.64	64.15	75.69	74.08	64.85	70.99	65.37	74.36	73.58	73.97	62.87	62.78	74.10	74.34	72.48	70.72	72.59	63.57	64.58	70.20	65.73	73.55	64.32
602	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	69.13	64.24	69.94	63.94	65.04	74.77	73.64	64.14	64.22	65.68	74.33	74.24	73.88	74.10	63.69	73.12	73.34	72.02	70.89	75.33	54.78	63.84	72.22	64.42	73.83	64.19
603	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	74.02	63.04	63.20	63.58	63.35	87.92	70.76	63.40	69.79	63.79	74.65	71.07	69.59	74.54	62.60	73.48	62.39	73.58	73.93	74.56	69.96	63.79	73.20	63.29	55.77	73.79
660	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	64.55	86.63	63.56	64.83	63.51	74.53	73.81	64.57	70.68	63.57	74.33	75.57	71.54	70.33	62.76	73.91	73.94	71.05	74.30	74.64	73.44	70.49	69.88	63.76	63.14	74.46
661	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	68.55	65.47	64.44	64.98	64.84	74.63	74.08	70.30	70.13	64.65	74.14	74.27	70.16	73.01	64.05	71.76	63.59	89.38	73.83	71.38	73.92	63.39	72.96	63.73	64.21	64.20
662	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	68.71	65.14	69.01	64.54	65.01	75.04	74.71	64.94	64.61	65.55	73.84	74.52	70.86	73.73	64.54	74.75	74.02	73.34	74.87	74.27	63.94	63.69	73.53	73.39	73.16	73.33
663	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	64.73	65.45	88.57	64.44	64.38	74.68	74.09	63.91	63.96	64.11	74.11	75.04	71.77	63.43	63.56	71.30	74.73	73.30	72.67	73.51	74.16	70.56	72.64	63.85	64.31	64.12
360	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	73.97	64.68	64.23	64.70	64.76	74.21	74.87	70.89	63.62	64.99	88.53	73.75	73.84	87.43	64.79	71.17	70.69	74.09	74.46	74.56	63.51	63.84	73.58	74.05	73.85	64.40
361	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	74.31	65.29	63.83	64.67	64.59	70.45	69.73	69.92	75.31	64.62	74.59	74.70	71.48	73.37	63.74	70.89	74.14	74.91	74.86	73.99	62.84	63.62	69.80	64.16	69.98	63.89
362	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	85.38	64.97	65.16	65.09	64.53	74.68	70.96	73.60	72.91	64.85	71.53	75.75	73.67	73.55	63.97	74.20	74.37	70.66	74.02	71.02	64.79	64.27	73.14	65.56	64.30	64.76
363	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	74.06	63.79	84.54	63.53	63.79	76.13	74.85	63.90	70.70	70.18	74.09	73.99	74.59	70.47	63.24	73.49	63.42	73.73	74.36	73.78	64.01	62.74	73.67	70.64	73.16	63.82
420	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	74.29	64.49	63.68	63.94	64.42	74.90	73.54	64.23	73.31	70.90	74.33	74.66	73.71	70.74	63.09	89.19	63.53	70.83	74.83	74.46	73.65	62.94	70.46	64.83	74.41	64.41
421	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	73.67	65.33	64.65	66.86	65.02	74.23	73.83	65.20	81.28	66.34	70.66	74.74	73.03	73.38	63.89	71.96	63.69	72.81	74.83	74.24	63.19	64.99	70.44	65.51	63.65	73.14
422	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	64.24	70.05	63.46	63.05	64.11	87.05	87.23	63.37	87.50	64.14	74.09	74.39	86.28	73.29	63.14	71.00	63.47	73.52	74.47	74.50	63.40	63.80	73.46	63.67	55.40	63.55
423	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	68.86	63.55	64.50	64.11	65.93	75.13	73.69	88.31	73.50	64.57	73.89	74.27	71.74	71.52	64.54	89.73	73.58	70.85	75.05	73.99	63.39	64.14	72.99	64.85	72.64	65.11
480	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	68.44	65.46	64.78	65.58	64.90	65.23	73.80	87.94	65.87	66.12	72.11	74.66	73.66	74.04	63.93	71.65	74.12	71.61	70.74	74.08	72.09	66.20	72.87	66.15	73.35	65.21
481	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	73.58	64.63	73.93	65.42	64.79	75.15	88.09	64.24	71.06	65.76	88.86	74.82	73.70	73.97	64.12	71.52	74.28	71.25	74.78	75.57	63.83	64.23	72.41	65.00	63.81	64.81
482	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	73.34	63.74	86.13	63.57	64.17	74.90	87.36	64.24	73.33	63.82	74.59	75.03	87.61	62.44	63.77	73.92	73.82	73.50	73.40	73.29	63.71	63.91	73.12	64.31	64.28	64.42
483	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.81	87.43	64.82	64.53	64.84	75.52	73.66	65.52	64.83	65.65	74.37	73.78	73.60	69.60	64.28	73.12	63.84	72.87	74.14	73.74	63.96	64.54	73.59	64.12	73.14	74.13
561	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	73.80	65.29	69.04	65.79	69.83	74.52	74.12	65.24	65.26	65.33	73.86	71.06	70.18	69.85	63.28	70.86	70.95	72.94	74.82	73.70	63.79	65.74	72.40	63.93	89.04	73.16
562	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	64.83	65.22	64.04	64.81	64.76	74.84	74.10	63.72	64.53	65.49	74.61	74.50	71.73	71.08	63.63	72.82	63.70	73.88	73.81	74.02	72.22	64.15	74.13	64.47	64.53	64.20
563	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	69.85	65.42	64.40	65.37	65.08	74.65	73.90	63.51	73.91	64.10	89.14	74.63	71.70	73.30	63.12	72.11	74.39	73.27	75.29	73.85	62.57	64.41	73.12	64.11	64.52	73.86
621	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	72.96	64.03	64.65	64.36	64.76	74.81	74.04	63.49	65.17	63.99	74.34	74.58	74.34	73.48	63.53	72.64	63.32	70.98	74.21	73.53	62.83	62.88	73.38	64.47	72.68	64.98
622	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	65.43	64.45	69.73	65.14	64.76	74.78	74.51	63.59	71.03	71.08	72.22	74.04	72.90	70.69	63.26	88.27	64.17	74.58	74.08	75.08	63.49	65.15	73.84	64.03	72.91	64.51
623	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	64.41	64.57	87.95	63.79	70.00	75.04	74.13	87.82	63.78	64.93	87.04	73.60	73.31	73.31	62.53	73.97	70.84	73.83	74.26	87.60	70.00	63.47	72.33	63.49	63.49	64.06
680	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	65.43	64.27	68.92	70.44	64.78	76.05	89.41	64.00	64.36	64.73	74.37	71.45	74.22	73.00	63.87	75.19	64.55	70.93	74.23	73.99	63.44	64.45	72.91	64.24	70.45	63.92
681	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	64.60	63.95	63.84	65.02	64.40	74.76	75.81	64.13	73.72	62.42	73.62	74.52	87.28	73.31	62.89	73.21	74.16	73.91	73.86	73.96	63.92	63.69	72.53	63.82	73.29	70.34
682	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	65.40	70.76	64.30	65.01	64.42	75.07	73.95	64.41	64.46	63.95	74.37	74.04	73.12	73.50	63.84	73.39	63.77	73.23	73.79	74.77	63.26	63.53	72.80	64.02	63.44	73.41
380	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	69.29	65.25	63.88	64.92	64.49	71.30	73.21	63.57	65.67	65.16	74.37	74.98	71.55	63.29	63.19	73.84	74.60	72.87	75.01	71.67	88.41	64.19	72.91	64.98	72.76	65.72
381	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	65.50	64.28	69.96	64.78	64.53	74.79	74.85	63.88	63.47	87.84	70.76	74.00	88.83	72.87	62.65	72.60	63.89	73.37	74.83	74.75	73.89	64.77	73.55	64.30	73.68	70.12
440	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	66.08	64.94	64.30	63.99	64.27	75.10	74.67	63.96	70.08	64.62	74.61	74.77	70.54	63.59	63.46	74.12	64.22	73.04	74.39	74.83	63.60	64.26	73.91	64.70	72.08	64.51
441	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	64.77	64.39	63.99	64.88	64.45	74.44	86.04	62.75	74.67	65.04	73.60	71.50	74.10	71.64	63.37	70.55	74.47	72.88	72.21	74.53	63.94	65.94	72.68	65.22	72.89	64.72
442	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	68.72	63.97	63.63	64.57	64.54	75.10	74.06	63.98	87.03	64.40	73.86	64.08	71.38	87.14	63.51	87.37	63.49	73.11	74.59	74.00	55.34	64.74	72.39	63.77	71.22	64.90
443	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	64.42	64.92	74.57	64.54	64.51	74.45	73.54	88.51	64.65	63.62	74.25	74.51	71.08	72.83	63.53	73.46	71.51	72.75	74.14	74.25	72.68	64.39	73.36	64.45	72.13	73.35
500	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	65.50	66.00	64.16	64.85	64.83	75.15	86.50	70.05	70.63	64.57	74.86	73.90	73.42	73.27	63.21	73.71	63.83	71.20	74.12	74.27	73.55	64.16	72.65	65.23	64.64	73.66
501	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	64.49	63.97	69.56	65.15	64.53	74.37	74.48	64.07	64.01	63.72	74.14	73.89	73.85	73.32	63.99	87.60	74.44	73.61	71.40	73.73	63.82	63.44	73.16	63.21	73.88	65.51
502	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	65.20	64.75	63.99	64.68	64.78	89.57	73.85	64.37	70.91	69.81	70.10	75.06	73.59	73.56	63.47	71.32	64.33	72.83	73.68	73.96	63.28	63.94	74.91	64.55	72.70	65.54
503	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.04	64.79	73.96	64.17	64.48	89.02	73.79	63.46	64.53	70.91	74.33	74.45	73.92	73.22	63.04	72.61	62.52	72.12	74.09	74.28	63.62	63.51	72.21	73.86	63.51	64.26
580	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	65.44	65.18	65.51	65.06	64.62	75.40	74.19	88.93	70.21	70.01	74.12	74.10	87.71	73.13	63.60	65.27	63.63	64.67	73.60	74.78	64.70	63.99	72.64	69.07	64.22	64.47
581	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	85.64	64.95	64.26	64.86	64.94	74.91	74.37	63.97	87.48	65.19	74.84	63.99	73.12	63.85	63.50	73.87	63.07	72.70	74.59	74.39	63.92	63.92	73.16	64.98	73.43	69.79
582	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	66.24	64.38	64.29	64.56	64.21	74.41	73.47	63.74	64.85	64.45	74.12	71.07	73.40	73.02	63.74	73.41	71.28	72.84	73.79	73.79	64.56	63.92	72.40	73.91	64.01	64.63
640	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	73.81	64.38	63.76	64.42	64.74	74.78	73.80	63.98	65.39	64.62	74.08	74.04	70.43	73.84	64.63	73.80	62.82	86.66	74.58	75.25	63.19	63.30	63.69	63.56	64.67	63.69
641	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.10	65.40	64.98	64.63	65.73	62.97	71.11	64.35	70.33	65.50	74.83	71.54	73.60	73.08	63.44	71.54	70.76	72.81	74.34	74.52	63.92	64.17	73.16	64.49	64.47	73.80
642	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	69.54	64.36	86.83	64.74	65.01	75.08	74.31	63.45	65.26	65.36	74.82	74.80	73.89	70.07	63.68	74.21	64.33	73.12	74.11	75.12	64.30	64.19	85.30	64.58	70.24	65.25
401	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	66.49	64.73	69.87	65.51	65.25	73.87	70.58	64.68	65.07	65.52	74.50	74.52	87.15	63.91	63.75	73.41	65.20	69.72	73.60	74.84	87.32	64.44	72.39	64.78	64.19	64.42
402	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	65.73	64.72	64.20	65.36	64.78	74.53	74.09	86.71	64.30	63.66	74.03	75.24	87.91	72.89	64.27	73.44	64.07	72.81	73.64	74.28	63.69	62.54	72.18	63.42	64.03	64.45
403	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	66.37	64.51	86.93	64.75	64.51	74.63	70.60	63.57	64.08	64.96	74.36	63.57	70.03	73.00	63.44	70.64	70.62	86.42	74.08	74.25	54.67	65.00	69.50	64.06	64.93	63.89
460	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	65.18	64.12	64.63	65.48	65.51	63.17	74.60	64.31	65.87	86.36	74.33	74.52	69.52	70.74	63.48	71.01	64.58	73.13	75.34	74.03	63.17	64.19	72.63	64.73	63.53	69.56
461	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	73.95	86.61	64.03	64.52	64.74	63.77	73.87	87.04	64.86	63.73	70.29	74.62	72.67	73.16	63.38	73.20	70.13	73.32	74.13	74.10	63.76	64.36	73.15	64.37	64.74	64.81
462	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	66.19	65.48	64.79	64.81	64.79	74.70	71.00	63.57	69.65	66.09	74.60	64.24	71.89	71.75	62.68	73.31	62.91	72.52	74.42	88.03	64.26	63.79	72.92	65.16	63.69	63.94
201	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	69.52	66.36	66.46	64.88	65.22	62.62	79.58	65.55	56.25	80.60	84.88	84.34	74.47	63.28	63.79	74.52	55.73	65.01	85.44	64.35	64.35	66.59	64.11	65.44	64.41	65.62
23	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	59.96	64.06	64.86	65.40	65.06	74.20	65.07	64.79	64.14	80.98	71.95	63.58	81.00	64.63	63.31	78.69	64.08	78.65	74.48	84.80	69.89	64.79	63.85	64.97	65.74	64.67
221	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	72.97	64.23	65.09	64.81	66.15	62.89	74.65	72.54	82.72	64.32	62.41	62.57	73.67	81.03	63.79	85.69	70.05	73.66	74.89	86.33	63.85	64.01	64.36	64.13	64.15	64.37
223	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	72.81	65.30	81.72	64.96	64.24	75.01	74.05	64.42	84.06	55.36	63.19	62.71	59.10	64.25	63.77	75.91	63.31	74.02	84.41	84.13	63.19	64.87	63.76	63.74	64.75	63.76
281	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	73.61	64.67	57.92	64.35	64.56	64.79	75.17	63.76	79.32	64.01	74.85	63.57	75.73	63.18	65.27	84.50	63.46	70.24	75.14	85.53	64.33	64.75	63.82	63.01	64.51	64.28
282	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	58.35	66.16	69.63	64.57	55.82	56.89	83.90	65.05	67.35	64.43	86.52	63.95	73.61	85.72	63.66	81.72	63.89	68.97	85.31	64.31	65.67	64.63	64.96	64.82	64.42	64.74
283	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	59.80	65.12	73.88	62.96	74.60	75.74	74.76	64.17	74.39	67.10	75.60	75.13	74.47	62.56	62.79	85.05	63.07	87.47	63.32	63.55	72.87	63.79	71.31	63.90	63.19	64.44
340	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	65.63	64.61	78.33	65.19	65.93	75.38	82.88	64.18	78.64	64.99	75.14	63.57	74.15	64.34	64.49	74.47	63.54	74.11	75.13	63.51	63.79	63.10	64.17	65.73	82.97	64.04
341	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	65.39	64.57	73.73	64.83	74.60	62.86	74.66	63.24	86.25	63.59	86.68	63.32	74.85	80.49	62.86	70.47	63.81	80.64	74.89	63.64	63.66	64.74	64.09	64.07	64.46	64.26
342	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.31	65.83	65.87	65.08	74.58	56.36	74.32	68.71	64.90	65.28	75.05	87.08	81.90	63.71	64.39	78.59	62.83	82.54	63.11	63.82	64.26	73.56	64.56	64.98	64.25	65.36
343	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	72.91	64.51	56.87	72.83	66.47	56.23	74.67	64.51	75.22	64.57	55.78	64.07	74.93	85.09	64.00	75.21	84.17	81.31	75.12	63.54	63.40	64.46	64.45	64.51	64.38	71.81
42	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	73.26	65.23	73.12	65.47	71.13	42.66	79.20	64.25	79.82	64.66	86.45	63.49	59.97	63.32	66.51	74.91	74.37	74.07	75.70	63.84	63.89	65.63	64.12	64.26	69.25	68.16
43	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	73.42	64.68	64.57	64.47	64.70	62.64	72.93	69.56	84.40	68.78	74.94	63.46	74.92	63.21	64.74	82.69	63.77	65.70	63.95	86.56	64.59	63.32	72.90	64.28	64.12	65.09
100	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	73.61	64.79	63.09	68.94	64.15	76.06	71.84	63.72	55.73	84.20	74.91	63.33	74.65	86.25	62.53	74.92	63.35	86.17	75.38	62.66	64.80	64.87	64.26	64.06	63.25	64.63
103	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	73.40	64.68	74.20	65.14	74.51	75.20	82.68	64.02	84.90	55.84	63.39	63.21	83.78	64.07	64.25	83.78	63.79	68.14	63.61	63.21	63.21	72.64	64.19	42.66	64.64	64.74
160	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	82.94	66.75	73.19	65.21	65.26	74.90	42.66	65.03	64.94	66.11	74.64	64.07	74.71	64.28	74.03	85.65	63.75	86.35	74.94	64.06	64.31	65.91	65.71	65.33	65.40	66.10

Size of the All data:  (140, 29)
Size of the Sig data:  (71, 29)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params1 = dt_valid.loc[dt_valid_sub1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params = optimal_params1.reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
24	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	89.87	57.19	57.80	57.89	58.04	75.37	75.47	57.66	58.41	58.15	75.42	69.03	67.85	74.30	59.76	87.44	57.61	68.26	76.30	74.44	57.19	56.08	75.81	57.92	75.57	75.15
50	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	66.99	57.95	57.97	57.99	58.45	75.27	73.90	57.82	68.69	68.57	75.89	75.47	68.85	68.76	59.19	68.75	69.02	68.50	75.24	69.12	56.15	56.11	76.39	56.94	57.55	68.78
7	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	74.44	57.16	67.44	56.97	57.58	75.05	68.88	90.24	66.74	58.01	75.39	75.61	89.38	74.53	57.96	67.64	73.67	68.75	76.06	75.18	56.46	56.42	75.99	56.58	76.41	56.50
8	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	58.98	58.73	67.71	58.92	59.32	69.31	74.13	59.53	57.91	59.45	70.18	75.12	75.74	74.78	58.40	90.65	73.99	73.83	75.13	74.59	46.73	90.06	74.36	57.51	74.15	75.94
18	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	74.68	59.35	57.15	57.55	57.78	74.94	91.32	57.83	58.50	57.85	74.59	75.73	74.11	74.97	57.38	73.78	74.85	74.84	75.36	75.76	57.03	56.51	75.59	76.05	75.78	56.92
58	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	58.64	58.94	59.01	58.17	58.81	76.42	75.36	58.90	69.49	58.62	75.65	74.91	73.61	58.58	57.97	73.16	74.50	70.42	69.03	69.86	57.38	57.45	69.37	58.31	75.27	56.77
49	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	69.98	58.46	68.88	57.50	58.86	75.07	74.03	58.49	58.21	58.05	74.64	75.65	74.58	74.62	58.03	75.03	75.51	68.37	69.40	76.23	46.31	56.89	74.32	57.10	75.08	56.98
48	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	74.84	57.26	57.24	56.99	57.03	90.30	68.50	57.50	69.94	56.32	76.46	69.58	68.72	74.77	57.65	73.67	56.95	74.36	76.50	76.28	68.12	56.79	75.17	56.68	49.92	76.02
11	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	58.34	91.10	58.11	57.58	57.98	75.54	74.71	58.84	68.04	58.28	76.54	76.81	68.50	68.70	57.52	74.67	74.63	69.13	75.89	75.68	76.01	68.09	69.78	56.55	55.71	76.49
35	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	67.30	60.29	58.98	58.22	58.76	75.25	74.80	67.95	68.77	58.20	74.84	74.68	68.32	74.29	58.50	68.84	57.79	93.55	75.13	69.93	75.55	56.89	74.48	57.15	58.09	56.64
14	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	69.33	58.48	68.50	58.68	60.00	76.03	75.43	60.39	60.34	59.32	75.88	75.66	68.51	74.59	59.97	74.50	74.01	73.92	75.72	74.93	57.75	57.23	75.40	76.21	75.55	74.59
30	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	58.50	59.62	90.65	57.59	58.04	75.85	75.05	58.25	58.19	58.26	76.12	75.32	68.98	58.34	58.19	68.79	75.28	74.33	70.13	75.65	76.11	68.35	75.43	58.07	57.01	57.67
1	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	74.55	58.26	59.14	58.66	58.00	75.57	74.88	68.59	58.14	58.80	90.38	75.50	74.88	88.42	60.37	68.85	68.68	73.70	75.17	74.87	56.55	56.83	75.74	75.89	76.27	56.68
42	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	75.18	57.97	58.16	58.40	57.97	68.88	68.88	67.93	76.25	58.03	75.77	76.05	68.70	74.76	58.25	69.32	74.53	75.77	75.60	75.07	56.54	56.55	69.04	56.94	68.02	56.87
21	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	88.82	59.21	59.34	58.37	58.02	74.66	69.45	74.19	73.95	57.72	67.64	75.60	74.25	74.33	58.42	74.06	74.93	69.04	75.63	70.02	58.32	57.44	75.14	58.53	58.29	57.54
9	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	75.43	57.93	88.10	57.33	57.72	76.21	75.65	58.40	69.25	68.26	76.11	75.72	74.46	68.90	58.20	74.82	58.22	73.58	75.65	75.17	56.44	57.07	75.98	69.14	76.66	56.77
13	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	75.37	58.60	57.71	57.79	58.82	74.57	74.83	58.96	74.38	69.41	75.13	74.78	74.07	68.48	57.92	91.07	57.80	69.23	75.77	75.83	75.19	57.01	69.40	56.67	76.17	56.94
34	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	74.57	60.97	60.84	61.24	60.20	74.60	74.76	60.45	77.75	59.39	68.87	76.52	73.74	73.93	60.41	68.75	59.09	73.35	74.82	75.01	56.78	58.45	68.83	58.72	57.27	75.64
16	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	58.42	67.98	57.41	57.06	57.60	91.19	90.28	57.67	90.55	57.47	75.88	76.00	90.11	74.74	58.71	68.02	57.11	74.82	75.43	74.75	56.79	56.73	75.61	57.20	51.76	56.73
2	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	69.83	57.97	57.72	58.61	60.69	75.94	74.29	90.52	74.60	58.28	76.15	75.95	69.41	68.74	60.04	88.93	74.36	68.36	77.12	74.62	56.29	57.85	75.36	58.98	75.67	57.88
17	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	67.76	58.81	59.59	58.94	60.04	59.97	74.09	89.43	58.99	59.22	69.15	75.52	73.91	74.47	58.87	68.22	73.81	68.78	67.94	75.03	74.63	61.02	74.90	61.50	75.94	59.80
3	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	74.87	59.09	75.42	59.07	58.13	74.76	90.21	57.60	69.49	58.80	91.09	76.05	74.91	74.07	58.75	67.52	75.19	69.99	76.17	75.52	57.67	57.68	75.91	57.39	57.01	57.11
6	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	74.42	57.62	89.58	56.73	58.08	75.59	90.86	57.66	74.92	57.02	76.06	75.41	89.26	56.89	59.28	74.74	74.46	75.06	74.35	75.30	57.08	56.88	75.55	56.86	56.22	56.30
10	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.64	85.96	59.63	58.22	59.02	74.69	74.11	59.98	59.13	59.18	75.17	75.08	75.43	68.42	58.74	73.70	58.37	73.95	74.57	74.86	57.20	57.57	75.22	58.61	75.34	76.00
12	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	74.31	59.72	68.94	59.57	68.11	75.26	74.33	60.15	60.08	58.74	74.83	68.12	68.62	68.62	58.74	67.09	69.29	73.65	75.29	75.11	58.20	58.65	74.60	59.23	91.65	75.17
62	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	58.20	59.67	58.46	58.19	58.70	74.48	74.30	58.57	58.19	59.24	75.34	75.66	68.27	69.13	58.35	74.63	58.44	74.53	74.44	74.97	74.75	57.28	75.89	57.30	57.38	57.98
19	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	70.92	58.50	57.82	58.98	59.58	75.33	74.16	58.03	74.51	58.20	90.39	74.98	68.50	74.31	57.43	68.18	74.89	74.16	76.03	74.75	56.94	57.95	75.48	57.99	59.87	74.67
53	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	74.54	57.78	57.99	58.68	58.51	75.36	75.12	58.98	58.49	58.55	75.87	74.95	74.95	73.91	57.77	69.16	57.25	68.27	73.35	75.39	57.08	56.45	75.30	57.72	76.01	57.08
27	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	58.45	58.27	68.42	59.21	57.97	74.99	75.08	57.59	68.80	69.80	69.51	75.79	74.18	68.20	57.28	87.32	58.94	73.79	74.67	75.52	57.03	58.49	75.86	57.41	76.00	57.35
0	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	58.18	58.42	91.98	57.06	68.91	74.41	73.84	90.31	58.18	57.48	93.18	74.15	73.99	74.59	56.89	75.16	68.94	73.17	75.50	89.45	70.20	57.50	75.11	56.51	57.19	57.13
40	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	58.96	58.47	69.01	68.47	58.85	76.65	91.16	59.07	58.27	58.77	75.42	69.50	74.17	73.71	58.87	75.50	58.52	68.37	75.84	74.58	58.24	59.34	75.72	57.88	69.17	56.98
23	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	58.34	58.75	58.66	58.34	59.27	74.05	76.66	57.89	74.93	58.17	74.68	75.15	89.19	74.33	57.37	73.39	74.89	74.53	74.69	74.50	57.50	57.19	75.61	57.34	75.92	68.37
51	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	58.99	68.98	58.66	59.39	58.56	76.94	75.03	57.27	58.25	57.99	75.11	75.11	72.17	74.31	58.09	73.99	57.47	74.41	75.57	74.74	57.41	58.40	73.87	57.03	56.58	75.81
32	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	69.85	58.79	58.48	58.77	58.35	67.44	74.21	58.89	59.05	57.97	75.16	75.41	67.60	58.49	57.58	74.39	75.05	73.69	75.96	68.50	91.87	58.00	74.64	59.22	74.84	57.39
4	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	58.72	58.40	68.62	58.59	58.45	75.12	75.03	58.46	57.03	89.57	70.42	75.22	89.51	74.11	58.10	73.49	58.39	74.31	75.57	76.42	75.28	58.26	75.89	56.97	76.19	68.44
64	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	58.71	58.30	58.09	57.59	57.71	75.66	74.34	58.09	68.36	58.65	74.91	75.07	68.03	58.23	58.24	73.38	58.75	73.80	75.19	74.91	56.41	57.95	76.51	57.82	70.23	58.34
37	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	59.06	58.98	58.25	57.92	58.80	75.78	86.72	57.08	74.33	58.18	74.87	67.77	74.89	69.09	58.96	69.00	73.83	73.85	70.73	75.36	57.50	59.13	74.68	60.06	75.43	57.64
29	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	69.36	58.34	57.22	57.59	58.94	75.80	74.09	57.26	91.27	58.09	75.63	57.97	67.55	91.12	58.37	90.14	57.35	71.85	75.47	75.31	47.36	57.57	75.29	56.75	68.98	57.75
5	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	58.99	58.74	75.06	57.80	58.51	74.45	73.12	90.53	58.18	57.71	76.06	76.13	67.43	75.55	58.56	74.33	69.50	74.28	74.71	75.17	75.02	58.36	75.42	56.92	69.42	75.76
20	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	58.62	59.55	59.43	59.42	59.38	74.78	88.80	67.89	68.83	58.61	75.19	74.82	73.90	73.75	58.71	73.81	57.80	68.64	74.15	75.42	74.47	58.25	75.92	57.64	59.19	75.97
31	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	58.74	58.56	68.55	58.06	58.70	75.73	74.24	58.51	56.90	58.08	75.36	75.42	75.44	75.10	57.84	89.89	74.56	73.40	69.32	74.53	57.75	57.50	75.27	56.83	75.75	57.29
39	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	58.71	58.58	58.45	57.63	58.51	91.40	74.09	58.49	69.13	68.58	69.80	76.53	74.93	74.84	57.40	69.09	58.21	74.28	75.63	73.23	57.64	57.41	76.97	58.26	74.96	57.87
25	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.88	58.19	74.82	57.96	59.25	91.70	73.19	57.60	57.64	68.18	75.13	75.43	73.97	75.44	58.74	73.41	56.85	73.15	75.13	75.30	56.56	57.13	75.82	76.14	56.83	57.47
26	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	58.68	59.12	59.82	58.82	59.07	76.34	74.53	91.43	68.52	68.34	75.62	75.09	88.54	73.74	59.08	58.89	59.04	59.23	75.40	74.58	58.22	57.59	75.41	66.74	57.51	57.90
28	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	90.46	58.81	59.19	59.11	59.16	75.41	73.88	58.43	88.79	58.51	75.46	58.86	74.32	58.27	59.00	74.15	58.55	73.63	74.74	75.05	57.50	58.00	75.33	57.78	75.38	68.10
52	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	59.25	58.45	59.19	57.95	58.23	75.18	74.23	57.51	57.70	58.09	74.69	70.32	74.43	74.88	57.74	74.24	69.77	74.64	74.92	75.37	57.80	57.75	76.24	75.39	57.74	57.32
60	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	74.19	58.31	58.76	56.99	59.50	76.67	74.30	58.73	59.12	58.15	74.87	75.89	68.37	74.29	60.18	73.26	58.29	89.91	75.89	75.08	57.50	56.03	57.30	57.11	57.48	57.71
47	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.24	59.81	59.21	58.32	61.54	57.26	68.62	59.23	69.27	57.98	75.63	69.57	73.80	73.02	60.03	67.25	69.76	74.16	75.22	75.16	57.97	57.97	75.60	58.54	57.89	76.11
15	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	70.87	58.63	91.63	59.26	58.94	75.27	73.61	58.52	60.50	60.45	76.52	75.17	73.96	69.71	59.31	72.68	58.06	73.74	75.42	74.43	58.43	57.25	90.34	59.43	69.45	59.08
36	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	58.79	58.54	68.82	60.03	60.49	74.60	68.59	58.84	58.24	58.62	75.61	75.44	89.48	59.07	58.50	73.53	59.14	68.91	74.69	75.42	91.11	59.30	76.29	58.08	58.48	58.99
33	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	58.74	57.18	57.98	58.50	58.53	75.86	74.31	87.09	57.63	57.79	75.31	75.13	89.14	74.58	58.83	71.36	59.09	71.96	75.20	74.43	56.98	57.84	75.18	57.72	57.16	58.06
57	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	59.74	57.96	92.21	58.44	58.79	75.05	68.83	56.83	58.35	58.41	76.15	56.78	67.53	74.23	57.44	67.70	69.76	89.08	75.15	75.11	46.88	57.82	70.14	57.29	56.98	57.32
55	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	58.71	57.68	58.63	58.66	59.44	57.98	73.45	58.09	59.70	90.41	75.30	75.42	68.69	69.00	58.02	68.07	59.13	73.86	76.36	75.65	57.07	57.75	75.16	57.87	58.13	68.57
22	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	74.23	87.93	58.70	58.54	58.94	57.92	74.10	89.63	58.52	57.40	69.93	74.69	75.16	74.95	57.74	72.79	68.83	73.42	74.81	75.39	57.87	61.34	76.18	58.29	57.80	59.91
65	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	58.76	59.93	60.39	58.73	59.06	73.99	68.26	58.44	69.55	58.83	75.47	59.00	67.99	69.47	58.04	75.34	58.89	72.77	76.30	91.06	58.13	56.70	75.29	57.97	58.69	58.06
63	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	71.81	59.25	63.19	58.23	59.25	57.14	83.18	57.52	51.91	86.58	87.50	89.32	75.80	57.16	57.55	75.72	49.66	57.31	88.68	56.48	57.44	58.41	56.88	56.40	57.32	57.18
56	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	58.22	57.50	58.12	58.46	58.59	76.37	58.98	58.78	57.82	87.52	67.37	57.26	83.45	57.48	58.12	82.84	57.66	80.70	76.33	88.83	67.35	57.13	56.37	56.85	57.85	57.28
38	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	74.86	58.38	58.51	58.35	60.32	57.58	74.77	65.30	86.29	57.82	57.58	56.79	75.15	84.31	57.43	88.58	66.37	75.57	76.51	90.76	56.47	56.13	56.57	56.81	55.77	57.47
66	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	73.96	59.25	85.90	58.23	59.02	76.79	74.72	57.48	86.52	53.53	57.61	57.37	56.31	57.30	57.43	77.16	57.05	75.73	90.20	88.62	55.86	57.45	56.68	56.35	56.38	56.92
68	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	74.92	58.90	52.31	58.14	59.44	56.52	74.92	56.86	83.52	57.10	76.33	57.26	76.48	56.08	57.17	87.62	57.51	64.14	76.60	88.25	57.47	56.68	55.82	55.82	56.78	56.93
67	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	55.02	58.19	64.99	58.76	50.63	50.42	87.66	57.54	64.27	58.82	89.28	56.88	75.24	89.48	58.00	86.01	57.07	63.92	90.98	56.76	57.78	56.50	57.30	57.26	56.63	57.18
41	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	54.09	58.26	74.93	57.56	75.44	76.39	75.61	57.36	75.87	58.99	77.70	76.90	76.17	57.64	58.00	87.76	56.59	90.85	56.76	56.56	71.18	56.60	75.74	56.26	56.45	56.30
43	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	59.50	58.60	81.92	58.26	58.33	76.09	86.18	57.66	81.27	58.02	76.14	57.50	76.52	57.84	57.56	76.71	58.35	75.57	75.92	56.53	57.95	57.24	57.01	57.74	87.20	56.68
44	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	59.82	58.51	75.03	58.45	74.41	57.71	74.15	58.10	87.40	57.39	91.32	57.31	75.82	82.72	57.73	68.77	56.98	84.57	76.84	56.44	57.04	57.08	57.44	56.51	57.63	56.93
46	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.98	58.79	65.05	59.11	74.40	50.26	76.00	64.33	58.61	59.09	76.16	90.39	86.00	58.01	57.96	82.49	56.98	86.52	56.71	56.76	57.89	71.72	57.07	57.43	57.84	57.00
61	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	74.01	58.54	50.55	69.49	59.12	50.44	75.19	57.80	74.80	58.51	50.25	57.75	75.16	87.81	57.64	75.39	87.55	87.07	76.32	56.38	56.76	56.98	56.92	56.93	56.62	70.58
69	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	73.96	59.04	74.98	59.39	65.85	49.17	82.61	57.87	83.10	58.55	90.88	57.44	57.13	57.84	58.37	76.14	75.66	74.38	77.05	57.50	57.12	57.93	57.93	56.91	67.03	60.49
54	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	74.86	57.77	58.57	58.16	59.39	57.23	74.83	62.22	88.99	62.71	75.67	56.75	75.38	57.38	59.44	86.77	56.92	62.66	56.50	90.31	57.48	56.54	75.39	56.19	57.73	56.37
45	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	74.76	57.71	57.82	60.73	58.48	76.63	73.21	56.75	51.41	88.69	76.96	56.95	76.59	89.25	56.28	77.09	57.01	89.39	75.92	55.99	56.81	57.55	56.45	56.44	56.76	56.31
70	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	74.48	58.38	75.26	59.12	74.51	76.15	87.18	57.66	89.33	50.27	57.20	56.88	87.78	58.25	57.70	88.17	58.24	62.23	57.03	56.40	56.19	70.14	56.31	49.17	57.31	56.93
59	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	84.75	60.23	73.98	59.25	59.58	76.24	49.17	58.77	59.34	59.28	76.26	57.50	75.34	58.27	75.15	88.18	57.69	91.72	76.00	57.29	58.15	58.11	57.28	57.39	57.76	58.50

Size of the test data:  (71, 34)

Difference

diff = dt[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt.columns,test_data_1.columns)):   
   diff[f'col_diff_{i}'] = (np.array(dt[cols[0]]) - np.array(test_data_1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff['negative_count'] = diff.apply(count_negatives, axis=1)
diff.sort_values(by =["negative_count"],inplace = True, ascending=False)

html_table = diff.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

# 
# show(diff)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
541	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-3.06	-6.25	-5.78	-6.40	-5.35	0.39	0.24	-6.67	-1.97	-1.64	1.78	0.98	-3.27	-2.03	-4.74	-2.97	-1.05	-2.70	0.90	-2.26	-6.39	-6.43	2.94	-6.88	-6.01	-1.49	20
601	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.83	-5.96	-5.32	-6.47	-5.34	0.73	1.28	-5.95	-1.50	-6.75	1.29	1.33	-0.36	-4.29	-4.81	-0.94	0.16	-2.06	-1.69	-2.73	-6.19	-7.13	-0.83	-7.42	1.72	-7.55	20
462	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.43	-5.55	-4.40	-6.08	-5.73	-0.71	-2.74	-5.13	-0.10	-7.26	0.87	-5.24	-3.90	-2.28	-4.64	2.03	-4.02	0.25	1.88	3.03	-6.13	-7.09	2.37	-7.19	-5.00	-5.88	20
282	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-3.33	-7.97	-4.64	-5.81	-5.19	-6.47	3.76	-7.51	-3.08	-5.61	2.76	-7.07	1.63	3.76	-5.66	4.29	-6.82	-5.05	5.67	-7.55	-7.89	-8.13	-7.66	-7.56	-7.79	-7.56	20
440	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.37	-6.64	-6.21	-6.40	-6.56	0.56	-0.33	-5.87	-1.72	-5.97	0.30	0.30	-2.51	-5.36	-5.22	-0.74	-5.47	0.76	0.80	0.08	-7.19	-6.31	2.60	-6.88	-1.85	-6.17	19
281	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.31	-5.77	-5.61	-6.21	-5.12	-8.27	-0.25	-6.90	4.20	-6.91	1.48	-6.31	0.75	-7.10	-8.10	3.12	-5.95	-6.10	1.46	2.72	-6.86	-8.07	-8.00	-7.19	-7.73	-7.35	19
342	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.67	-7.04	-0.82	-5.97	-0.18	-6.10	1.68	-4.38	-6.29	-6.19	1.11	3.31	4.10	-5.70	-6.43	3.90	-5.85	3.98	-6.40	-7.06	-6.37	-1.84	-7.49	-7.55	-6.41	-8.36	19
460	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.47	-6.44	-6.00	-6.82	-6.07	-5.19	-1.15	-6.22	-6.17	4.05	0.97	0.90	-0.83	-1.74	-5.46	-2.94	-5.45	0.73	1.02	1.62	-6.10	-6.44	2.53	-6.86	-5.40	-0.99	19
341	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.57	-6.06	1.30	-6.38	-0.19	-5.15	-0.51	-5.14	1.15	-6.20	4.64	-6.01	0.97	2.23	-5.13	-1.70	-6.83	3.93	1.95	-7.20	-6.62	-7.66	-6.65	-7.56	-6.83	-7.33	19
23	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-1.74	-6.56	-6.74	-6.94	-6.47	2.17	-6.09	-6.01	-6.32	6.54	-4.58	-6.32	2.45	-7.15	-5.19	4.15	-6.42	2.05	1.85	4.03	-2.54	-7.66	-7.48	-8.12	-7.89	-7.39	19
640	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.38	-6.07	-5.00	-7.43	-5.24	1.89	0.50	-5.25	-6.27	-6.47	0.79	1.85	-2.06	0.45	-4.45	-0.54	-4.53	3.25	1.31	-0.17	-5.69	-7.27	-6.39	-6.45	-7.19	-5.98	18
641	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.14	-5.59	-5.77	-6.31	-4.19	-5.71	-2.49	-5.12	-1.06	-7.52	0.80	-1.97	0.20	-0.06	-3.41	-4.29	-1.00	1.35	0.88	0.64	-5.95	-6.20	2.44	-5.95	-6.58	2.31	18
622	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.98	-6.18	-1.31	-5.93	-6.79	0.21	0.57	-6.00	-2.23	-1.28	-2.71	1.75	1.28	-2.49	-5.98	-0.95	-5.23	-0.79	0.59	0.44	-6.46	-6.66	2.02	-6.62	3.09	-7.16	18
403	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.63	-6.55	5.28	-6.31	-5.72	0.42	-1.77	-6.74	-5.73	-6.55	1.79	-6.79	-2.50	1.23	-6.00	-2.94	-0.86	2.66	1.07	0.86	-7.79	-7.18	0.64	-6.77	-7.95	-6.57	18
201	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.29	-7.11	-3.27	-6.65	-5.97	-5.48	3.60	-8.03	-4.34	5.98	2.62	4.98	1.33	-6.12	-6.24	1.20	-6.07	-7.70	3.24	-7.87	-6.91	-8.18	-7.23	-9.04	-7.09	-8.44	18
441	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.71	-5.41	-5.74	-6.96	-5.65	1.34	0.68	-5.67	-0.34	-6.86	1.27	-3.73	0.79	-2.55	-4.41	-1.55	-0.64	0.97	-1.48	0.83	-6.44	-6.81	2.00	-5.16	2.54	-7.08	18
362	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.44	-5.76	-5.82	-6.72	-6.51	-0.02	-1.51	0.59	1.04	-7.13	-3.89	-0.15	0.58	0.78	-5.55	-0.14	0.56	-1.62	1.61	-1.00	-6.47	-6.83	2.00	-7.03	-6.01	-7.22	18
43	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.44	-6.91	-6.00	-6.31	-5.31	-5.41	1.90	-7.34	4.59	-6.07	0.73	-6.71	0.46	-5.83	-5.30	4.08	-6.85	-3.04	-7.45	3.75	-7.11	-6.78	2.49	-8.09	-6.39	-8.72	18
343	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.10	-5.97	-6.32	-3.34	-7.35	-5.79	0.52	-6.71	-0.42	-6.06	-5.53	-6.32	0.23	2.72	-6.36	0.18	3.38	5.76	1.20	-7.16	-6.64	-7.48	-7.53	-7.58	-7.76	-1.23	18
223	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.15	-6.05	4.18	-6.73	-5.22	1.78	0.67	-6.94	2.46	-1.83	-5.58	-5.34	-2.79	-6.95	-6.34	1.25	-6.26	1.71	5.79	4.49	-7.33	-7.42	-7.08	-7.39	-8.37	-6.84	17
401	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.70	-6.19	-1.05	-5.48	-4.76	0.73	-1.99	-5.84	-6.83	-6.90	1.11	0.92	2.33	-4.84	-5.25	0.12	-6.06	-0.81	1.09	0.58	3.79	-5.14	3.90	-6.70	-5.71	-5.43	17
103	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.08	-6.30	1.06	-6.02	-0.00	0.95	4.50	-6.36	4.43	-5.57	-6.19	-6.33	4.00	-5.82	-6.55	4.39	-5.55	-5.91	-6.58	-6.81	-7.02	-2.50	-7.88	6.51	-7.33	-7.81	17
502	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.49	-6.17	-5.54	-7.05	-6.27	1.83	0.24	-5.88	-1.78	-1.23	-0.30	1.47	1.34	1.28	-6.07	-2.23	-6.12	1.45	1.95	-0.73	-5.64	-6.53	2.06	-6.29	2.26	-7.67	17
580	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.76	-6.06	-5.69	-6.24	-5.55	0.94	0.34	2.50	-1.69	-1.67	1.50	0.99	0.83	0.61	-4.52	-6.38	-4.59	-5.44	1.80	-0.20	-6.48	-6.40	2.77	-2.33	-6.71	-6.57	17
680	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.47	-5.80	0.09	-1.97	-5.93	0.60	1.75	-4.93	-6.09	-5.96	1.05	-1.95	-0.05	0.71	-5.00	0.31	-6.03	-2.56	1.61	0.59	-5.20	-5.11	2.81	-6.36	-1.28	-6.94	17
642	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.33	-5.73	4.80	-5.48	-6.07	0.19	-0.70	-4.93	-4.76	-4.91	1.70	0.37	0.07	-0.36	-4.37	-1.53	-6.27	0.62	1.31	-0.69	-5.87	-6.94	5.04	-5.15	-0.79	-6.17	17
402	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.99	-7.54	-6.22	-6.86	-6.25	1.33	0.22	0.38	-6.67	-5.87	1.28	-0.11	1.23	1.69	-5.44	-2.08	-4.98	-0.85	1.56	0.15	-6.71	-4.70	3.00	-5.70	-6.87	-6.39	17
421	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.90	-4.36	-3.81	-5.62	-4.82	0.37	0.93	-4.75	-3.53	-6.95	-1.79	1.78	0.71	0.55	-3.48	-3.21	-4.60	0.54	-0.01	0.77	-6.41	-6.54	-1.61	-6.79	-6.38	2.50	17
562	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.63	-5.55	-5.58	-6.62	-6.06	-0.36	0.20	-5.15	-6.34	-6.25	0.73	1.16	-3.46	-1.95	-5.28	1.81	-5.26	0.65	0.63	0.95	2.53	-6.87	1.76	-7.17	-7.15	-6.22	17
661	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-1.25	-5.18	-5.46	-6.76	-6.08	0.62	0.72	-2.35	-1.36	-6.45	0.70	0.41	-1.84	1.28	-5.55	-2.92	-5.80	4.17	1.30	-1.45	1.63	-6.50	1.52	-6.58	-6.12	-7.56	17
361	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.87	-7.32	-5.67	-6.27	-6.62	-1.57	-0.85	-1.99	0.94	-6.59	1.18	1.35	-2.78	1.39	-5.49	-1.57	0.39	0.86	0.74	1.08	-6.30	-7.07	-0.76	-7.22	-1.96	-7.02	17
480	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.68	-6.65	-5.19	-6.64	-4.86	-5.26	0.29	1.49	-6.88	-6.90	-2.96	0.86	0.25	0.43	-5.06	-3.43	-0.31	-2.83	-2.80	0.95	2.54	-5.18	2.03	-4.65	2.59	-5.41	17
221	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.89	-5.85	-6.58	-6.46	-5.83	-5.31	0.12	-7.24	3.57	-6.50	-4.83	-5.78	1.48	3.28	-6.36	2.89	-3.68	1.91	1.62	4.43	-7.38	-7.88	-7.79	-7.32	-8.38	-6.90	17
42	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.70	-6.19	1.86	-6.08	-5.28	6.51	3.41	-6.38	3.28	-6.11	4.43	-6.05	-2.84	-5.48	-8.14	1.23	1.29	0.31	1.35	-6.34	-6.77	-7.70	-6.19	-7.35	-2.22	-7.67	16
340	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.13	-6.01	3.59	-6.93	-7.60	0.71	3.30	-6.52	2.63	-6.97	1.00	-6.07	2.37	-6.50	-6.93	2.24	-5.19	1.46	0.79	-6.98	-5.84	-5.86	-7.16	-7.99	4.23	-7.36	16
100	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.15	-7.08	-5.27	-8.21	-5.67	0.57	1.37	-6.97	-4.32	4.49	2.05	-6.38	1.94	3.00	-6.25	2.17	-6.34	3.22	0.54	-6.67	-7.99	-7.32	-7.81	-7.62	-6.49	-8.32	16
501	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.75	-5.41	-1.01	-7.09	-5.83	1.36	-0.24	-5.56	-7.11	-5.64	1.22	1.53	1.59	1.78	-6.15	2.29	0.12	-0.21	-2.08	0.80	-6.07	-5.94	2.11	-6.38	1.87	-8.22	16
160	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.81	-6.52	0.79	-5.96	-5.68	1.34	6.51	-6.26	-5.60	-6.83	1.62	-6.57	0.63	-6.01	1.12	2.53	-6.06	5.37	1.06	-6.77	-6.16	-7.80	-8.43	-7.94	-7.64	-7.60	16
663	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.23	-5.83	2.08	-6.85	-6.34	1.17	0.96	-5.66	-5.77	-5.85	2.01	0.28	-2.79	-5.09	-5.37	-2.51	0.55	1.03	-2.54	2.14	1.95	-2.21	2.79	-5.78	-7.30	-6.45	16
442	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.64	-5.63	-6.41	-6.98	-5.60	0.70	0.03	-6.72	4.24	-6.31	1.77	-6.11	-3.83	3.98	-5.14	2.77	-6.14	-1.26	0.88	1.31	-7.98	-7.17	2.90	-7.02	-2.24	-7.15	16
542	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.13	-6.78	-1.75	-6.71	-6.05	0.69	-1.06	2.20	-3.88	-6.17	1.16	1.34	-0.17	1.04	-5.41	-1.52	-0.40	-1.50	1.94	1.14	-5.49	-6.72	3.21	-7.12	2.29	-7.09	16
682	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.41	-1.78	-5.64	-5.62	-5.86	1.87	1.08	-7.14	-6.21	-5.96	0.74	1.07	-0.95	0.81	-5.75	0.60	-6.30	1.18	1.78	-0.03	-5.85	-5.13	1.07	-6.99	-6.86	2.40	16
481	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.29	-5.54	1.49	-6.35	-6.66	-0.39	2.12	-6.64	-1.57	-6.96	2.23	1.23	1.21	0.10	-5.37	-4.00	0.91	-1.26	1.39	-0.05	-6.16	-6.55	3.50	-7.61	-6.80	-7.70	16
621	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.58	-6.25	-6.66	-5.68	-6.25	0.55	1.08	-4.51	-6.68	-5.44	1.53	0.37	0.61	0.43	-5.76	-3.48	-6.07	-2.71	-0.86	1.86	-5.75	-6.43	1.92	-6.75	3.33	-7.90	16
561	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.51	-5.57	-0.10	-6.22	-1.72	0.74	0.21	-5.09	-5.18	-6.59	0.97	-2.94	-1.56	-1.23	-4.54	-3.77	-1.66	0.71	0.47	1.41	-5.59	-7.09	2.20	-4.70	2.61	2.01	16
483	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.17	-1.47	-5.19	-6.31	-5.82	-0.83	0.45	-5.54	-5.70	-6.47	0.80	1.30	1.83	-1.18	-5.54	0.58	-5.47	1.08	0.43	1.12	-6.76	-6.97	1.63	-5.51	2.20	1.87	15
283	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.71	-6.86	1.05	-5.40	0.84	0.65	0.85	-6.81	1.48	-8.11	2.10	1.77	1.70	-4.92	-4.79	2.71	-6.48	3.38	-6.56	-6.99	-1.69	-7.19	4.43	-7.64	-6.74	-8.14	15
363	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.37	-5.86	3.56	-6.20	-6.07	0.08	0.80	-5.50	-1.45	-1.92	2.02	1.73	-0.13	-1.57	-5.04	1.33	-5.20	-0.15	1.29	1.39	-7.57	-5.67	2.31	-1.50	3.50	-7.05	15
420	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.08	-5.89	-5.97	-6.15	-5.60	-0.33	1.29	-5.27	1.07	-1.49	0.80	0.12	0.36	-2.26	-5.17	1.88	-5.73	-1.60	0.94	1.37	1.54	-5.93	-1.06	-8.16	1.76	-7.47	15
422	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.82	-2.07	-6.05	-5.99	-6.51	4.14	3.05	-5.70	3.05	-6.67	1.79	1.61	3.83	1.45	-4.43	-2.98	-6.36	1.30	0.96	0.25	-6.61	-7.07	2.15	-6.47	-3.64	-6.82	15
500	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.88	-6.45	-4.73	-5.43	-5.45	-0.37	2.30	-2.16	-1.80	-5.96	0.33	0.92	0.48	0.48	-4.50	0.10	-6.03	-2.56	0.03	1.15	0.92	-5.91	3.27	-7.59	-5.45	2.31	15
461	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.28	1.32	-5.33	-5.98	-5.80	-5.85	0.23	2.59	-6.34	-6.33	-0.36	0.07	2.49	1.79	-5.64	-0.41	-1.30	0.10	0.68	1.29	-5.89	-3.02	3.03	-6.08	-6.94	-4.90	15
540	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.74	-6.81	-6.19	-5.82	-6.34	0.74	1.31	-6.37	-6.26	-6.64	0.79	-2.27	-2.77	0.77	-5.00	0.04	-6.01	-2.13	2.33	0.18	-6.80	-6.52	2.90	-5.88	1.90	1.22	15
660	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.21	4.47	-5.45	-7.25	-5.53	1.01	0.90	-5.73	-2.64	-5.29	2.21	1.24	-3.04	-1.63	-5.24	0.76	0.69	-1.92	1.59	1.04	2.57	-2.40	-0.10	-7.21	-7.43	2.03	15
623	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.23	-6.15	4.03	-6.73	-1.09	-0.63	-0.29	2.49	-5.60	-7.45	6.14	0.55	0.68	1.28	-5.64	1.19	-1.90	-0.66	1.24	1.85	0.20	-5.97	2.78	-6.98	-6.30	-6.93	15
582	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.99	-5.93	-5.10	-6.61	-5.98	0.77	0.76	-6.23	-7.15	-6.36	0.57	-0.75	1.03	1.86	-6.00	0.83	-1.51	1.80	1.13	1.58	-6.76	-6.17	3.84	1.48	-6.27	-7.31	15
581	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.82	-6.14	-5.07	-5.75	-5.78	0.50	-0.49	-5.54	1.31	-6.68	0.62	-5.13	1.20	-5.58	-4.50	0.28	-4.52	0.93	0.15	0.66	-6.42	-5.92	2.17	-7.20	1.95	-1.69	15
380	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.56	-6.46	-5.40	-6.15	-6.14	-3.86	1.00	-4.68	-6.62	-7.19	0.79	0.43	-3.95	-4.80	-5.61	0.55	0.45	0.82	0.95	-3.17	3.46	-6.19	1.73	-5.76	2.08	-8.33	15
543	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.73	-6.30	-1.79	-6.14	-5.69	-1.31	-0.14	-4.77	-5.88	-5.14	-1.50	2.07	1.55	0.78	-5.92	2.26	-0.63	1.10	0.38	0.36	-8.74	3.54	1.31	-7.09	1.23	2.41	15
603	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.82	-5.78	-5.96	-6.59	-6.32	2.38	-2.26	-5.90	0.15	-7.47	1.81	-1.49	-0.87	0.23	-4.95	0.19	-5.44	0.78	2.57	1.72	-1.84	-7.00	1.97	-6.61	-5.85	2.23	15
602	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.85	-5.78	-1.06	-6.44	-6.18	0.30	0.39	-5.65	-6.01	-7.63	0.31	1.41	0.70	0.52	-5.66	1.91	2.17	-3.65	-1.49	0.90	-8.47	-6.95	2.10	-7.32	1.25	-7.21	14
423	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.97	-5.58	-6.78	-5.50	-5.24	0.81	0.60	2.21	1.10	-6.29	2.26	1.68	-2.33	-2.78	-4.50	-0.80	0.78	-2.49	2.07	0.63	-7.10	-6.29	2.37	-5.87	3.03	-7.23	14
360	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.58	-6.42	-5.09	-6.04	-6.76	1.36	0.01	-2.30	-5.48	-6.19	1.85	1.75	1.04	0.99	-4.42	-2.32	-2.01	-0.39	0.71	0.31	-6.96	-7.01	2.16	1.84	2.42	-7.72	14
443	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.43	-6.18	0.49	-6.74	-6.00	-0.00	-0.42	2.02	-6.47	-5.91	1.81	1.62	-3.65	2.72	-4.97	0.87	-2.01	1.53	0.57	0.92	2.34	-6.03	2.06	-7.53	-2.71	2.41	13
662	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.62	-6.66	-0.51	-5.86	-5.01	0.99	0.72	-4.55	-4.27	-6.23	2.04	1.14	-2.35	0.86	-4.57	-0.25	-0.01	0.58	0.85	0.66	-6.19	-6.46	1.87	2.82	2.39	1.26	13
563	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.07	-6.92	-6.58	-6.39	-5.50	0.68	0.26	-5.48	0.60	-5.90	1.25	0.35	-3.20	1.01	-5.69	-3.93	0.50	0.89	0.74	0.90	-5.63	-6.46	2.36	-6.12	-4.65	0.81	13
681	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.26	-5.20	-5.18	-6.68	-5.13	-0.71	0.85	-6.24	1.21	-4.25	1.06	0.63	1.91	1.02	-5.52	0.18	0.73	0.62	0.83	0.54	-6.42	-6.50	3.08	-6.48	2.63	-1.97	13
503	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.84	-6.60	0.86	-6.21	-5.23	2.68	-0.60	-5.86	-6.89	-2.73	0.80	0.98	0.05	2.22	-4.30	0.80	-5.67	1.03	1.04	1.02	-7.06	-6.38	3.61	2.28	-6.68	-6.79	13
381	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.78	-5.88	-1.34	-6.19	-6.08	0.33	0.18	-5.42	-6.44	1.73	-0.34	1.22	0.68	1.24	-4.55	0.89	-5.50	0.94	0.74	1.67	1.39	-6.51	2.34	-7.33	2.51	-1.68	13
600	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.87	-5.24	-6.43	-5.47	-5.89	0.16	3.78	-5.72	-6.06	-5.82	0.57	1.96	0.24	0.80	-4.98	-1.11	0.76	0.88	0.54	0.97	-6.44	-6.62	2.43	2.49	2.61	-7.09	12
482	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.08	-6.12	3.45	-6.84	-6.09	0.69	3.50	-6.58	1.59	-6.80	1.47	0.38	1.65	-5.55	-4.49	0.82	0.64	1.56	0.95	2.01	-6.63	-7.03	2.43	-7.45	-8.06	-8.12	12

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_16	75.624507	5.703662
mAP_valid_abs_values_7	74.990423	6.199911
mAP_valid_abs_values_11	74.701690	5.569680
mAP_valid_abs_values_13	74.609859	5.777028
mAP_valid_abs_values_19	74.014085	3.541885
mAP_valid_abs_values_18	73.907183	4.935307
mAP_valid_abs_values_20	73.636479	5.674818
mAP_valid_abs_values_6	72.796761	7.295900
mAP_valid_abs_values_12	71.844648	5.172016
mAP_valid_abs_values_14	71.547746	6.042366
mAP_valid_abs_values_23	71.076338	3.972736
mAP_valid_abs_values_9	70.199296	7.383349
mAP_valid_abs_values	69.794507	5.598650
mAP_valid_abs_values_3	68.341549	7.105455
mAP_valid_abs_values_25	68.045915	5.639856
mAP_valid_abs_values_17	67.792817	5.346892
mAP_valid_abs_values_8	67.551972	7.633763
mAP_valid_abs_values_26	66.744930	3.723547
mAP_valid_abs_values_10	66.451831	5.529089
mAP_valid_abs_values_2	65.853944	4.595918
mAP_valid_abs_values_21	65.531408	5.711575
mAP_valid_abs_values_5	65.360986	2.816002
mAP_valid_abs_values_4	64.928310	1.435519
mAP_valid_abs_values_24	64.906338	3.744198
mAP_valid_abs_values_22	64.898169	3.276207
mAP_valid_abs_values_15	63.807887	1.416292

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_7	75.583803	6.947502
mAP_test_abs_values_16	75.562394	7.400759
mAP_test_abs_values_11	75.360986	7.385620
mAP_test_abs_values_19	74.560563	5.644686
mAP_test_abs_values_13	74.553521	7.157026
mAP_test_abs_values_18	73.910704	7.144941
mAP_test_abs_values_20	73.288028	8.594499
mAP_test_abs_values_6	72.380563	9.188958
mAP_test_abs_values_23	71.242817	7.903738
mAP_test_abs_values_12	70.937183	8.279000
mAP_test_abs_values_14	70.510423	8.905256
mAP_test_abs_values	67.773803	8.960143
mAP_test_abs_values_9	67.568873	10.702296
average_map	66.901988	1.346355
mAP_test_abs_values_3	65.276479	10.466402
mAP_test_abs_values_25	64.902113	9.598245
mAP_test_abs_values_17	64.491268	8.219003
mAP_test_abs_values_8	62.819859	10.229975
mAP_test_abs_values_26	61.737324	7.387494
mAP_test_abs_values_10	61.367183	8.294788
mAP_test_abs_values_21	60.589859	8.865566
mAP_test_abs_values_2	60.134366	6.246953
mAP_test_abs_values_5	59.978169	4.242234
mAP_test_abs_values_24	59.002676	5.200085
mAP_test_abs_values_4	58.686338	1.950619
mAP_test_abs_values_22	58.680141	4.808960
mAP_test_abs_values_15	58.552254	2.172237

Model performance on validation data (Mann-Whitney U Test)

Statistical Significance:

Using the global mean maximum row as the reference, we perform the right-tailed t-test to identify significant hyperparameters.

pvalues_mw = []
pvalues_real_mw = []

for _,index in enumerate(dt_valid_sub.index):

  _, p_value_mw = stats.mannwhitneyu(max_row[:-1], dt_valid_sub.loc[index][:-1], alternative='greater')#, method = 'asymptotic')
  pvalues_real_mw.append(p_value_mw)
  pvalues_mw.append((p_value_mw >= 0.05)*1)
  

dt_valid_sub_mw['pvalues_mw'] = pvalues_real_mw
dt_valid_sub_mw['sig_mw'] = pvalues_mw

dt_valid_sub_mw1 = dt_valid_sub_mw.query('sig_mw == 1')


max_indexx = dt_valid_sub_mw1.iloc[:, :-3].mean().idxmax()

#print(sum(pvalues),max_indexx)

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_valid_abs_values	mAP_valid_abs_values_2	mAP_valid_abs_values_3	mAP_valid_abs_values_4	mAP_valid_abs_values_5	mAP_valid_abs_values_6	mAP_valid_abs_values_7	mAP_valid_abs_values_8	mAP_valid_abs_values_9	mAP_valid_abs_values_10	mAP_valid_abs_values_11	mAP_valid_abs_values_12	mAP_valid_abs_values_13	mAP_valid_abs_values_14	mAP_valid_abs_values_15	mAP_valid_abs_values_16	mAP_valid_abs_values_17	mAP_valid_abs_values_18	mAP_valid_abs_values_19	mAP_valid_abs_values_20	mAP_valid_abs_values_21	mAP_valid_abs_values_22	mAP_valid_abs_values_23	mAP_valid_abs_values_24	mAP_valid_abs_values_25	mAP_valid_abs_values_26
540	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	85.13	64.00	63.99	63.71	64.38	74.63	74.16	64.03	64.67	64.79	74.63	71.30	70.62	73.53	64.76	87.40	63.62	70.39	73.97	74.26	63.99	62.60	72.91	63.80	73.67	73.93
541	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	70.05	64.20	63.75	64.39	63.80	74.88	73.66	64.49	70.66	70.21	74.11	74.49	72.12	70.79	63.93	71.72	70.07	71.20	74.34	71.38	62.54	62.54	73.45	63.82	63.56	70.27
542	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	73.31	63.94	69.19	63.68	63.63	74.36	69.94	88.04	70.62	64.18	74.23	74.27	89.55	73.49	63.37	69.16	74.07	70.25	74.12	74.04	61.95	63.14	72.78	63.70	74.12	63.59
543	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	65.71	65.03	69.50	65.06	65.01	70.62	74.27	64.30	63.79	64.59	71.68	73.05	74.19	74.00	64.32	88.39	74.62	72.73	74.75	74.23	55.47	86.52	73.05	64.60	72.92	73.53
600	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	73.81	64.59	63.58	63.02	63.67	74.78	87.54	63.55	64.56	63.67	74.02	73.77	73.87	74.17	62.36	74.89	74.09	73.96	74.82	74.79	63.47	63.13	73.16	73.56	73.17	64.01
601	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	64.47	64.90	64.33	64.64	64.15	75.69	74.08	64.85	70.99	65.37	74.36	73.58	73.97	62.87	62.78	74.10	74.34	72.48	70.72	72.59	63.57	64.58	70.20	65.73	73.55	64.32
602	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	69.13	64.24	69.94	63.94	65.04	74.77	73.64	64.14	64.22	65.68	74.33	74.24	73.88	74.10	63.69	73.12	73.34	72.02	70.89	75.33	54.78	63.84	72.22	64.42	73.83	64.19
603	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	74.02	63.04	63.20	63.58	63.35	87.92	70.76	63.40	69.79	63.79	74.65	71.07	69.59	74.54	62.60	73.48	62.39	73.58	73.93	74.56	69.96	63.79	73.20	63.29	55.77	73.79
660	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	64.55	86.63	63.56	64.83	63.51	74.53	73.81	64.57	70.68	63.57	74.33	75.57	71.54	70.33	62.76	73.91	73.94	71.05	74.30	74.64	73.44	70.49	69.88	63.76	63.14	74.46
661	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	68.55	65.47	64.44	64.98	64.84	74.63	74.08	70.30	70.13	64.65	74.14	74.27	70.16	73.01	64.05	71.76	63.59	89.38	73.83	71.38	73.92	63.39	72.96	63.73	64.21	64.20
662	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	68.71	65.14	69.01	64.54	65.01	75.04	74.71	64.94	64.61	65.55	73.84	74.52	70.86	73.73	64.54	74.75	74.02	73.34	74.87	74.27	63.94	63.69	73.53	73.39	73.16	73.33
663	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	64.73	65.45	88.57	64.44	64.38	74.68	74.09	63.91	63.96	64.11	74.11	75.04	71.77	63.43	63.56	71.30	74.73	73.30	72.67	73.51	74.16	70.56	72.64	63.85	64.31	64.12
360	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	73.97	64.68	64.23	64.70	64.76	74.21	74.87	70.89	63.62	64.99	88.53	73.75	73.84	87.43	64.79	71.17	70.69	74.09	74.46	74.56	63.51	63.84	73.58	74.05	73.85	64.40
361	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	74.31	65.29	63.83	64.67	64.59	70.45	69.73	69.92	75.31	64.62	74.59	74.70	71.48	73.37	63.74	70.89	74.14	74.91	74.86	73.99	62.84	63.62	69.80	64.16	69.98	63.89
362	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	85.38	64.97	65.16	65.09	64.53	74.68	70.96	73.60	72.91	64.85	71.53	75.75	73.67	73.55	63.97	74.20	74.37	70.66	74.02	71.02	64.79	64.27	73.14	65.56	64.30	64.76
363	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	74.06	63.79	84.54	63.53	63.79	76.13	74.85	63.90	70.70	70.18	74.09	73.99	74.59	70.47	63.24	73.49	63.42	73.73	74.36	73.78	64.01	62.74	73.67	70.64	73.16	63.82
420	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	74.29	64.49	63.68	63.94	64.42	74.90	73.54	64.23	73.31	70.90	74.33	74.66	73.71	70.74	63.09	89.19	63.53	70.83	74.83	74.46	73.65	62.94	70.46	64.83	74.41	64.41
421	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	73.67	65.33	64.65	66.86	65.02	74.23	73.83	65.20	81.28	66.34	70.66	74.74	73.03	73.38	63.89	71.96	63.69	72.81	74.83	74.24	63.19	64.99	70.44	65.51	63.65	73.14
422	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	64.24	70.05	63.46	63.05	64.11	87.05	87.23	63.37	87.50	64.14	74.09	74.39	86.28	73.29	63.14	71.00	63.47	73.52	74.47	74.50	63.40	63.80	73.46	63.67	55.40	63.55
423	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	68.86	63.55	64.50	64.11	65.93	75.13	73.69	88.31	73.50	64.57	73.89	74.27	71.74	71.52	64.54	89.73	73.58	70.85	75.05	73.99	63.39	64.14	72.99	64.85	72.64	65.11
480	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	68.44	65.46	64.78	65.58	64.90	65.23	73.80	87.94	65.87	66.12	72.11	74.66	73.66	74.04	63.93	71.65	74.12	71.61	70.74	74.08	72.09	66.20	72.87	66.15	73.35	65.21
481	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	73.58	64.63	73.93	65.42	64.79	75.15	88.09	64.24	71.06	65.76	88.86	74.82	73.70	73.97	64.12	71.52	74.28	71.25	74.78	75.57	63.83	64.23	72.41	65.00	63.81	64.81
482	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	73.34	63.74	86.13	63.57	64.17	74.90	87.36	64.24	73.33	63.82	74.59	75.03	87.61	62.44	63.77	73.92	73.82	73.50	73.40	73.29	63.71	63.91	73.12	64.31	64.28	64.42
483	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.81	87.43	64.82	64.53	64.84	75.52	73.66	65.52	64.83	65.65	74.37	73.78	73.60	69.60	64.28	73.12	63.84	72.87	74.14	73.74	63.96	64.54	73.59	64.12	73.14	74.13
560	372	8	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	64.95	64.73	64.68	69.72	64.53	74.94	73.55	64.04	72.36	63.84	74.11	74.48	73.90	63.71	63.55	73.35	64.27	73.35	75.07	74.25	64.18	63.99	72.88	64.24	64.09	64.78
561	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	73.80	65.29	69.04	65.79	69.83	74.52	74.12	65.24	65.26	65.33	73.86	71.06	70.18	69.85	63.28	70.86	70.95	72.94	74.82	73.70	63.79	65.74	72.40	63.93	89.04	73.16
562	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	64.83	65.22	64.04	64.81	64.76	74.84	74.10	63.72	64.53	65.49	74.61	74.50	71.73	71.08	63.63	72.82	63.70	73.88	73.81	74.02	72.22	64.15	74.13	64.47	64.53	64.20
563	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	69.85	65.42	64.40	65.37	65.08	74.65	73.90	63.51	73.91	64.10	89.14	74.63	71.70	73.30	63.12	72.11	74.39	73.27	75.29	73.85	62.57	64.41	73.12	64.11	64.52	73.86
620	372	8	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	65.42	64.18	63.24	64.19	64.27	73.94	74.17	64.43	64.14	63.76	74.12	73.58	73.69	73.50	63.07	71.30	64.10	72.71	74.60	73.75	64.26	63.79	72.91	64.27	64.53	63.92
621	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	72.96	64.03	64.65	64.36	64.76	74.81	74.04	63.49	65.17	63.99	74.34	74.58	74.34	73.48	63.53	72.64	63.32	70.98	74.21	73.53	62.83	62.88	73.38	64.47	72.68	64.98
622	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	65.43	64.45	69.73	65.14	64.76	74.78	74.51	63.59	71.03	71.08	72.22	74.04	72.90	70.69	63.26	88.27	64.17	74.58	74.08	75.08	63.49	65.15	73.84	64.03	72.91	64.51
623	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	64.41	64.57	87.95	63.79	70.00	75.04	74.13	87.82	63.78	64.93	87.04	73.60	73.31	73.31	62.53	73.97	70.84	73.83	74.26	87.60	70.00	63.47	72.33	63.49	63.49	64.06
680	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	65.43	64.27	68.92	70.44	64.78	76.05	89.41	64.00	64.36	64.73	74.37	71.45	74.22	73.00	63.87	75.19	64.55	70.93	74.23	73.99	63.44	64.45	72.91	64.24	70.45	63.92
681	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	64.60	63.95	63.84	65.02	64.40	74.76	75.81	64.13	73.72	62.42	73.62	74.52	87.28	73.31	62.89	73.21	74.16	73.91	73.86	73.96	63.92	63.69	72.53	63.82	73.29	70.34
682	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	65.40	70.76	64.30	65.01	64.42	75.07	73.95	64.41	64.46	63.95	74.37	74.04	73.12	73.50	63.84	73.39	63.77	73.23	73.79	74.77	63.26	63.53	72.80	64.02	63.44	73.41
380	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	69.29	65.25	63.88	64.92	64.49	71.30	73.21	63.57	65.67	65.16	74.37	74.98	71.55	63.29	63.19	73.84	74.60	72.87	75.01	71.67	88.41	64.19	72.91	64.98	72.76	65.72
381	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	65.50	64.28	69.96	64.78	64.53	74.79	74.85	63.88	63.47	87.84	70.76	74.00	88.83	72.87	62.65	72.60	63.89	73.37	74.83	74.75	73.89	64.77	73.55	64.30	73.68	70.12
382	372	8	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	74.03	64.20	64.10	64.44	64.51	71.04	74.25	63.60	63.65	65.40	74.37	64.54	71.38	73.59	63.73	73.50	63.64	71.14	74.76	74.02	63.42	63.60	72.65	63.41	64.14	73.63
383	372	8	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	68.45	64.14	64.01	66.00	64.04	74.36	73.93	63.43	63.85	64.78	74.39	70.34	72.82	72.78	63.39	73.29	74.30	72.57	74.31	70.82	63.51	63.93	72.42	64.85	64.04	64.28
440	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	66.08	64.94	64.30	63.99	64.27	75.10	74.67	63.96	70.08	64.62	74.61	74.77	70.54	63.59	63.46	74.12	64.22	73.04	74.39	74.83	63.60	64.26	73.91	64.70	72.08	64.51
441	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	64.77	64.39	63.99	64.88	64.45	74.44	86.04	62.75	74.67	65.04	73.60	71.50	74.10	71.64	63.37	70.55	74.47	72.88	72.21	74.53	63.94	65.94	72.68	65.22	72.89	64.72
442	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	68.72	63.97	63.63	64.57	64.54	75.10	74.06	63.98	87.03	64.40	73.86	64.08	71.38	87.14	63.51	87.37	63.49	73.11	74.59	74.00	55.34	64.74	72.39	63.77	71.22	64.90
443	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	64.42	64.92	74.57	64.54	64.51	74.45	73.54	88.51	64.65	63.62	74.25	74.51	71.08	72.83	63.53	73.46	71.51	72.75	74.14	74.25	72.68	64.39	73.36	64.45	72.13	73.35
500	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	65.50	66.00	64.16	64.85	64.83	75.15	86.50	70.05	70.63	64.57	74.86	73.90	73.42	73.27	63.21	73.71	63.83	71.20	74.12	74.27	73.55	64.16	72.65	65.23	64.64	73.66
501	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	64.49	63.97	69.56	65.15	64.53	74.37	74.48	64.07	64.01	63.72	74.14	73.89	73.85	73.32	63.99	87.60	74.44	73.61	71.40	73.73	63.82	63.44	73.16	63.21	73.88	65.51
502	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	65.20	64.75	63.99	64.68	64.78	89.57	73.85	64.37	70.91	69.81	70.10	75.06	73.59	73.56	63.47	71.32	64.33	72.83	73.68	73.96	63.28	63.94	74.91	64.55	72.70	65.54
503	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.04	64.79	73.96	64.17	64.48	89.02	73.79	63.46	64.53	70.91	74.33	74.45	73.92	73.22	63.04	72.61	62.52	72.12	74.09	74.28	63.62	63.51	72.21	73.86	63.51	64.26
580	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	65.44	65.18	65.51	65.06	64.62	75.40	74.19	88.93	70.21	70.01	74.12	74.10	87.71	73.13	63.60	65.27	63.63	64.67	73.60	74.78	64.70	63.99	72.64	69.07	64.22	64.47
581	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	85.64	64.95	64.26	64.86	64.94	74.91	74.37	63.97	87.48	65.19	74.84	63.99	73.12	63.85	63.50	73.87	63.07	72.70	74.59	74.39	63.92	63.92	73.16	64.98	73.43	69.79
582	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	66.24	64.38	64.29	64.56	64.21	74.41	73.47	63.74	64.85	64.45	74.12	71.07	73.40	73.02	63.74	73.41	71.28	72.84	73.79	73.79	64.56	63.92	72.40	73.91	64.01	64.63
583	372	8	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	65.09	64.55	65.03	64.35	65.88	64.21	75.53	63.91	64.77	65.43	75.18	63.32	88.89	63.87	63.39	70.92	63.00	70.91	74.52	74.58	63.71	64.19	72.63	64.47	63.47	64.40
640	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	73.81	64.38	63.76	64.42	64.74	74.78	73.80	63.98	65.39	64.62	74.08	74.04	70.43	73.84	64.63	73.80	62.82	86.66	74.58	75.25	63.19	63.30	63.69	63.56	64.67	63.69
641	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.10	65.40	64.98	64.63	65.73	62.97	71.11	64.35	70.33	65.50	74.83	71.54	73.60	73.08	63.44	71.54	70.76	72.81	74.34	74.52	63.92	64.17	73.16	64.49	64.47	73.80
642	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	69.54	64.36	86.83	64.74	65.01	75.08	74.31	63.45	65.26	65.36	74.82	74.80	73.89	70.07	63.68	74.21	64.33	73.12	74.11	75.12	64.30	64.19	85.30	64.58	70.24	65.25
643	372	8	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	65.74	64.63	64.76	64.90	65.20	63.38	73.76	64.82	64.77	65.17	73.87	74.18	73.09	70.71	63.24	73.25	65.26	73.74	73.85	73.83	64.43	64.41	69.55	64.34	73.89	65.14
400	372	8	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	66.20	64.76	63.92	64.74	64.96	74.89	74.31	63.94	64.22	64.33	74.12	74.45	73.39	61.81	64.17	72.85	62.89	70.02	74.80	70.58	53.26	63.90	71.91	63.67	73.11	69.72
401	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	66.49	64.73	69.87	65.51	65.25	73.87	70.58	64.68	65.07	65.52	74.50	74.52	87.15	63.91	63.75	73.41	65.20	69.72	73.60	74.84	87.32	64.44	72.39	64.78	64.19	64.42
402	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	65.73	64.72	64.20	65.36	64.78	74.53	74.09	86.71	64.30	63.66	74.03	75.24	87.91	72.89	64.27	73.44	64.07	72.81	73.64	74.28	63.69	62.54	72.18	63.42	64.03	64.45
403	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	66.37	64.51	86.93	64.75	64.51	74.63	70.60	63.57	64.08	64.96	74.36	63.57	70.03	73.00	63.44	70.64	70.62	86.42	74.08	74.25	54.67	65.00	69.50	64.06	64.93	63.89
460	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	65.18	64.12	64.63	65.48	65.51	63.17	74.60	64.31	65.87	86.36	74.33	74.52	69.52	70.74	63.48	71.01	64.58	73.13	75.34	74.03	63.17	64.19	72.63	64.73	63.53	69.56
461	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	73.95	86.61	64.03	64.52	64.74	63.77	73.87	87.04	64.86	63.73	70.29	74.62	72.67	73.16	63.38	73.20	70.13	73.32	74.13	74.10	63.76	64.36	73.15	64.37	64.74	64.81
462	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	66.19	65.48	64.79	64.81	64.79	74.70	71.00	63.57	69.65	66.09	74.60	64.24	71.89	71.75	62.68	73.31	62.91	72.52	74.42	88.03	64.26	63.79	72.92	65.16	63.69	63.94
463	372	8	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	65.48	64.40	64.51	64.79	64.78	74.83	69.76	62.74	69.83	64.41	74.39	63.14	73.39	70.44	63.87	73.13	63.62	72.79	74.11	74.57	64.17	63.74	73.89	63.92	72.93	64.89
520	372	8	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	65.31	64.60	64.78	65.43	65.50	64.32	73.87	64.15	63.17	69.97	73.59	63.85	73.92	73.33	63.33	73.77	73.15	71.33	75.60	74.31	62.91	63.56	73.16	64.53	74.40	65.48
521	372	8	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	65.76	64.53	64.49	64.86	64.91	64.07	73.87	63.78	64.24	70.75	74.59	74.36	73.18	73.56	63.39	70.78	64.77	72.83	73.83	74.54	52.54	64.12	69.33	64.79	71.94	64.80
522	372	8	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	65.62	64.78	65.25	64.95	64.45	74.37	73.89	65.01	64.59	65.08	74.09	63.49	71.23	64.11	63.76	70.42	64.30	73.30	73.57	74.80	64.42	64.96	72.18	64.62	64.98	65.50
523	372	8	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	66.59	64.31	64.91	65.55	65.20	74.62	74.65	63.80	64.35	64.75	74.58	70.46	73.14	73.06	64.11	69.53	63.79	73.06	74.36	75.32	65.13	65.08	72.41	65.43	64.85	64.65
241	372	8	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	65.52	65.31	65.47	64.68	64.96	65.52	72.65	64.85	71.45	64.82	63.94	63.55	73.98	64.01	64.52	73.90	64.85	71.67	74.98	63.96	74.09	65.84	65.48	64.03	64.95	64.92
123	372	8	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	72.61	42.66	64.97	66.33	64.86	80.04	72.29	75.41	63.73	65.71	74.61	63.85	74.97	63.78	64.29	60.82	64.82	56.93	63.90	64.92	72.36	66.39	65.07	64.59	65.40	65.07
201	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	69.52	66.36	66.46	64.88	65.22	62.62	79.58	65.55	56.25	80.60	84.88	84.34	74.47	63.28	63.79	74.52	55.73	65.01	85.44	64.35	64.35	66.59	64.11	65.44	64.41	65.62
202	372	8	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	73.51	65.44	79.13	65.35	65.31	74.50	73.90	66.06	74.00	64.95	64.29	64.54	74.93	84.04	62.98	75.04	64.38	63.63	64.55	63.08	65.29	64.91	64.30	65.75	64.84	65.84
203	372	8	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	81.08	66.21	65.59	64.61	65.62	75.66	73.03	64.71	74.16	65.89	74.88	63.69	74.98	63.75	63.81	74.97	63.49	64.33	74.93	63.69	66.56	64.54	63.49	65.31	64.92	65.15
261	372	8	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	73.47	64.77	65.38	64.35	74.03	63.06	73.62	64.19	80.27	55.12	63.31	74.61	74.89	63.88	62.98	74.51	63.20	63.38	75.13	74.54	64.81	63.95	62.89	63.03	64.41	76.21
263	372	8	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	72.49	65.81	55.95	65.06	73.21	56.78	82.61	64.86	64.36	76.89	64.20	63.58	69.93	67.45	63.99	75.07	82.60	75.06	63.80	63.66	64.09	64.96	65.97	64.79	65.23	68.04
322	372	8	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	71.35	65.28	73.54	64.86	65.64	63.12	78.69	64.37	76.31	59.30	64.29	63.74	74.96	64.09	62.66	64.81	64.34	74.99	82.05	81.35	64.54	64.65	64.51	63.89	64.41	64.38
323	372	8	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	73.21	65.50	73.17	64.98	64.65	75.32	80.29	65.20	60.64	64.62	74.92	63.57	74.88	63.94	63.68	80.57	79.32	64.05	63.19	63.03	64.50	63.73	63.99	64.20	64.62	63.97
20	372	8	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	75.96	65.17	64.68	65.31	64.95	62.88	73.32	66.03	79.43	65.83	63.83	81.91	74.70	64.30	64.90	73.80	64.60	73.81	56.01	64.64	67.00	65.37	55.86	65.59	65.33	66.48
22	372	8	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	72.13	64.89	72.28	64.86	64.68	74.94	80.86	64.81	74.53	63.85	84.53	63.09	68.22	68.47	64.20	74.28	62.71	67.71	75.00	62.55	63.47	64.59	64.63	63.57	64.20	64.37
23	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	59.96	64.06	64.86	65.40	65.06	74.20	65.07	64.79	64.14	80.98	71.95	63.58	81.00	64.63	63.31	78.69	64.08	78.65	74.48	84.80	69.89	64.79	63.85	64.97	65.74	64.67
81	372	8	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	73.49	42.66	64.70	67.44	70.89	75.36	73.54	64.78	73.98	82.46	85.97	63.84	75.06	63.01	66.22	64.28	64.78	64.98	63.95	63.51	65.57	66.20	64.86	65.33	64.86	65.10
83	372	8	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	57.19	65.59	69.85	64.98	64.94	64.31	72.23	63.78	65.15	64.58	63.55	64.57	74.65	74.47	62.83	83.62	81.92	74.91	75.13	55.99	64.35	66.05	66.18	65.30	65.28	65.10
142	372	8	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	72.61	64.34	64.73	65.34	65.03	74.33	70.39	64.69	64.69	73.89	64.09	63.59	73.99	63.62	64.46	74.50	64.06	74.49	74.64	82.54	63.28	65.17	64.74	65.02	64.56	64.73
143	372	8	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	64.25	65.17	65.23	65.24	69.36	75.28	65.84	64.58	65.62	56.87	74.81	70.81	74.62	63.56	64.52	84.84	65.02	65.30	75.64	64.09	65.95	65.43	64.94	65.62	64.25	65.09
221	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	72.97	64.23	65.09	64.81	66.15	62.89	74.65	72.54	82.72	64.32	62.41	62.57	73.67	81.03	63.79	85.69	70.05	73.66	74.89	86.33	63.85	64.01	64.36	64.13	64.15	64.37
223	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	72.81	65.30	81.72	64.96	64.24	75.01	74.05	64.42	84.06	55.36	63.19	62.71	59.10	64.25	63.77	75.91	63.31	74.02	84.41	84.13	63.19	64.87	63.76	63.74	64.75	63.76
281	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	73.61	64.67	57.92	64.35	64.56	64.79	75.17	63.76	79.32	64.01	74.85	63.57	75.73	63.18	65.27	84.50	63.46	70.24	75.14	85.53	64.33	64.75	63.82	63.01	64.51	64.28
282	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	58.35	66.16	69.63	64.57	55.82	56.89	83.90	65.05	67.35	64.43	86.52	63.95	73.61	85.72	63.66	81.72	63.89	68.97	85.31	64.31	65.67	64.63	64.96	64.82	64.42	64.74
283	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	59.80	65.12	73.88	62.96	74.60	75.74	74.76	64.17	74.39	67.10	75.60	75.13	74.47	62.56	62.79	85.05	63.07	87.47	63.32	63.55	72.87	63.79	71.31	63.90	63.19	64.44
340	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	65.63	64.61	78.33	65.19	65.93	75.38	82.88	64.18	78.64	64.99	75.14	63.57	74.15	64.34	64.49	74.47	63.54	74.11	75.13	63.51	63.79	63.10	64.17	65.73	82.97	64.04
341	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	65.39	64.57	73.73	64.83	74.60	62.86	74.66	63.24	86.25	63.59	86.68	63.32	74.85	80.49	62.86	70.47	63.81	80.64	74.89	63.64	63.66	64.74	64.09	64.07	64.46	64.26
342	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.31	65.83	65.87	65.08	74.58	56.36	74.32	68.71	64.90	65.28	75.05	87.08	81.90	63.71	64.39	78.59	62.83	82.54	63.11	63.82	64.26	73.56	64.56	64.98	64.25	65.36
343	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	72.91	64.51	56.87	72.83	66.47	56.23	74.67	64.51	75.22	64.57	55.78	64.07	74.93	85.09	64.00	75.21	84.17	81.31	75.12	63.54	63.40	64.46	64.45	64.51	64.38	71.81
40	372	8	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	73.91	64.55	55.75	64.56	74.77	75.16	73.14	64.30	64.00	64.56	74.86	62.75	85.48	74.40	63.29	71.17	63.12	55.64	83.74	63.06	73.57	63.86	63.43	64.79	64.29	64.76
41	372	8	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	73.61	64.80	73.58	65.31	64.99	63.80	83.33	65.18	73.03	66.01	74.59	63.19	73.64	82.58	64.97	74.46	65.97	62.20	63.87	63.23	63.42	65.55	64.90	65.18	65.20	64.41
42	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	73.26	65.23	73.12	65.47	71.13	42.66	79.20	64.25	79.82	64.66	86.45	63.49	59.97	63.32	66.51	74.91	74.37	74.07	75.70	63.84	63.89	65.63	64.12	64.26	69.25	68.16
43	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	73.42	64.68	64.57	64.47	64.70	62.64	72.93	69.56	84.40	68.78	74.94	63.46	74.92	63.21	64.74	82.69	63.77	65.70	63.95	86.56	64.59	63.32	72.90	64.28	64.12	65.09
100	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	73.61	64.79	63.09	68.94	64.15	76.06	71.84	63.72	55.73	84.20	74.91	63.33	74.65	86.25	62.53	74.92	63.35	86.17	75.38	62.66	64.80	64.87	64.26	64.06	63.25	64.63
103	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	73.40	64.68	74.20	65.14	74.51	75.20	82.68	64.02	84.90	55.84	63.39	63.21	83.78	64.07	64.25	83.78	63.79	68.14	63.61	63.21	63.21	72.64	64.19	42.66	64.64	64.74
160	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	82.94	66.75	73.19	65.21	65.26	74.90	42.66	65.03	64.94	66.11	74.64	64.07	74.71	64.28	74.03	85.65	63.75	86.35	74.94	64.06	64.31	65.91	65.71	65.33	65.40	66.10
163	372	8	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	73.17	73.42	64.84	72.31	59.26	76.17	58.08	66.16	83.89	42.66	75.39	62.98	73.82	64.82	64.65	84.85	62.78	64.25	75.14	63.55	63.28	63.56	64.77	64.77	64.49	64.59

Size of the All data:  (140, 29)
Size of the Sig data:  (100, 34)

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params_mw1 = dt_valid.loc[dt_valid_sub_mw1.index][['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
optimal_params_mw = optimal_params_mw1.reset_index()
optimal_params_mw.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_mw1 = pd.merge(optimal_params_mw, dt_test, on=['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg'])
test_data_1_sub_mw = test_data_mw1[list(test_data_mw1.columns[test_data_mw1.columns.str.startswith('mAP_test')])]

Equivalent test data

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	mAP_test_abs_values	mAP_test_abs_values_2	mAP_test_abs_values_3	mAP_test_abs_values_4	mAP_test_abs_values_5	mAP_test_abs_values_6	mAP_test_abs_values_7	mAP_test_abs_values_8	mAP_test_abs_values_9	mAP_test_abs_values_10	mAP_test_abs_values_11	mAP_test_abs_values_12	mAP_test_abs_values_13	mAP_test_abs_values_14	mAP_test_abs_values_15	mAP_test_abs_values_16	mAP_test_abs_values_17	mAP_test_abs_values_18	mAP_test_abs_values_19	mAP_test_abs_values_20	mAP_test_abs_values_21	mAP_test_abs_values_22	mAP_test_abs_values_23	mAP_test_abs_values_24	mAP_test_abs_values_25	mAP_test_abs_values_26
24	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	89.87	57.19	57.80	57.89	58.04	75.37	75.47	57.66	58.41	58.15	75.42	69.03	67.85	74.30	59.76	87.44	57.61	68.26	76.30	74.44	57.19	56.08	75.81	57.92	75.57	75.15
50	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	66.99	57.95	57.97	57.99	58.45	75.27	73.90	57.82	68.69	68.57	75.89	75.47	68.85	68.76	59.19	68.75	69.02	68.50	75.24	69.12	56.15	56.11	76.39	56.94	57.55	68.78
7	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	74.44	57.16	67.44	56.97	57.58	75.05	68.88	90.24	66.74	58.01	75.39	75.61	89.38	74.53	57.96	67.64	73.67	68.75	76.06	75.18	56.46	56.42	75.99	56.58	76.41	56.50
8	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	58.98	58.73	67.71	58.92	59.32	69.31	74.13	59.53	57.91	59.45	70.18	75.12	75.74	74.78	58.40	90.65	73.99	73.83	75.13	74.59	46.73	90.06	74.36	57.51	74.15	75.94
18	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	74.68	59.35	57.15	57.55	57.78	74.94	91.32	57.83	58.50	57.85	74.59	75.73	74.11	74.97	57.38	73.78	74.85	74.84	75.36	75.76	57.03	56.51	75.59	76.05	75.78	56.92
58	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	58.64	58.94	59.01	58.17	58.81	76.42	75.36	58.90	69.49	58.62	75.65	74.91	73.61	58.58	57.97	73.16	74.50	70.42	69.03	69.86	57.38	57.45	69.37	58.31	75.27	56.77
49	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	69.98	58.46	68.88	57.50	58.86	75.07	74.03	58.49	58.21	58.05	74.64	75.65	74.58	74.62	58.03	75.03	75.51	68.37	69.40	76.23	46.31	56.89	74.32	57.10	75.08	56.98
48	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	74.84	57.26	57.24	56.99	57.03	90.30	68.50	57.50	69.94	56.32	76.46	69.58	68.72	74.77	57.65	73.67	56.95	74.36	76.50	76.28	68.12	56.79	75.17	56.68	49.92	76.02
11	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	58.34	91.10	58.11	57.58	57.98	75.54	74.71	58.84	68.04	58.28	76.54	76.81	68.50	68.70	57.52	74.67	74.63	69.13	75.89	75.68	76.01	68.09	69.78	56.55	55.71	76.49
35	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	67.30	60.29	58.98	58.22	58.76	75.25	74.80	67.95	68.77	58.20	74.84	74.68	68.32	74.29	58.50	68.84	57.79	93.55	75.13	69.93	75.55	56.89	74.48	57.15	58.09	56.64
14	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	69.33	58.48	68.50	58.68	60.00	76.03	75.43	60.39	60.34	59.32	75.88	75.66	68.51	74.59	59.97	74.50	74.01	73.92	75.72	74.93	57.75	57.23	75.40	76.21	75.55	74.59
30	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	58.50	59.62	90.65	57.59	58.04	75.85	75.05	58.25	58.19	58.26	76.12	75.32	68.98	58.34	58.19	68.79	75.28	74.33	70.13	75.65	76.11	68.35	75.43	58.07	57.01	57.67
1	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	74.55	58.26	59.14	58.66	58.00	75.57	74.88	68.59	58.14	58.80	90.38	75.50	74.88	88.42	60.37	68.85	68.68	73.70	75.17	74.87	56.55	56.83	75.74	75.89	76.27	56.68
42	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	75.18	57.97	58.16	58.40	57.97	68.88	68.88	67.93	76.25	58.03	75.77	76.05	68.70	74.76	58.25	69.32	74.53	75.77	75.60	75.07	56.54	56.55	69.04	56.94	68.02	56.87
21	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	88.82	59.21	59.34	58.37	58.02	74.66	69.45	74.19	73.95	57.72	67.64	75.60	74.25	74.33	58.42	74.06	74.93	69.04	75.63	70.02	58.32	57.44	75.14	58.53	58.29	57.54
9	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	75.43	57.93	88.10	57.33	57.72	76.21	75.65	58.40	69.25	68.26	76.11	75.72	74.46	68.90	58.20	74.82	58.22	73.58	75.65	75.17	56.44	57.07	75.98	69.14	76.66	56.77
13	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	75.37	58.60	57.71	57.79	58.82	74.57	74.83	58.96	74.38	69.41	75.13	74.78	74.07	68.48	57.92	91.07	57.80	69.23	75.77	75.83	75.19	57.01	69.40	56.67	76.17	56.94
34	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	74.57	60.97	60.84	61.24	60.20	74.60	74.76	60.45	77.75	59.39	68.87	76.52	73.74	73.93	60.41	68.75	59.09	73.35	74.82	75.01	56.78	58.45	68.83	58.72	57.27	75.64
16	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	58.42	67.98	57.41	57.06	57.60	91.19	90.28	57.67	90.55	57.47	75.88	76.00	90.11	74.74	58.71	68.02	57.11	74.82	75.43	74.75	56.79	56.73	75.61	57.20	51.76	56.73
2	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	69.83	57.97	57.72	58.61	60.69	75.94	74.29	90.52	74.60	58.28	76.15	75.95	69.41	68.74	60.04	88.93	74.36	68.36	77.12	74.62	56.29	57.85	75.36	58.98	75.67	57.88
17	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	67.76	58.81	59.59	58.94	60.04	59.97	74.09	89.43	58.99	59.22	69.15	75.52	73.91	74.47	58.87	68.22	73.81	68.78	67.94	75.03	74.63	61.02	74.90	61.50	75.94	59.80
3	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	74.87	59.09	75.42	59.07	58.13	74.76	90.21	57.60	69.49	58.80	91.09	76.05	74.91	74.07	58.75	67.52	75.19	69.99	76.17	75.52	57.67	57.68	75.91	57.39	57.01	57.11
6	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	74.42	57.62	89.58	56.73	58.08	75.59	90.86	57.66	74.92	57.02	76.06	75.41	89.26	56.89	59.28	74.74	74.46	75.06	74.35	75.30	57.08	56.88	75.55	56.86	56.22	56.30
10	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	74.64	85.96	59.63	58.22	59.02	74.69	74.11	59.98	59.13	59.18	75.17	75.08	75.43	68.42	58.74	73.70	58.37	73.95	74.57	74.86	57.20	57.57	75.22	58.61	75.34	76.00
65	372	8	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	59.11	58.73	59.22	70.27	59.19	75.77	74.68	59.04	74.89	59.70	76.14	75.36	74.93	58.55	59.03	74.37	58.58	74.04	76.06	75.11	58.12	56.98	73.68	57.14	56.98	57.10
12	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	74.31	59.72	68.94	59.57	68.11	75.26	74.33	60.15	60.08	58.74	74.83	68.12	68.62	68.62	58.74	67.09	69.29	73.65	75.29	75.11	58.20	58.65	74.60	59.23	91.65	75.17
62	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	58.20	59.67	58.46	58.19	58.70	74.48	74.30	58.57	58.19	59.24	75.34	75.66	68.27	69.13	58.35	74.63	58.44	74.53	74.44	74.97	74.75	57.28	75.89	57.30	57.38	57.98
19	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	70.92	58.50	57.82	58.98	59.58	75.33	74.16	58.03	74.51	58.20	90.39	74.98	68.50	74.31	57.43	68.18	74.89	74.16	76.03	74.75	56.94	57.95	75.48	57.99	59.87	74.67
80	372	8	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	58.04	57.78	57.17	57.71	57.77	74.90	74.98	58.24	57.93	57.54	75.40	75.06	72.99	74.28	57.31	68.84	58.65	74.95	75.72	75.36	57.41	56.77	75.47	57.34	57.71	57.01
53	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	74.54	57.78	57.99	58.68	58.51	75.36	75.12	58.98	58.49	58.55	75.87	74.95	74.95	73.91	57.77	69.16	57.25	68.27	73.35	75.39	57.08	56.45	75.30	57.72	76.01	57.08
27	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	58.45	58.27	68.42	59.21	57.97	74.99	75.08	57.59	68.80	69.80	69.51	75.79	74.18	68.20	57.28	87.32	58.94	73.79	74.67	75.52	57.03	58.49	75.86	57.41	76.00	57.35
0	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	58.18	58.42	91.98	57.06	68.91	74.41	73.84	90.31	58.18	57.48	93.18	74.15	73.99	74.59	56.89	75.16	68.94	73.17	75.50	89.45	70.20	57.50	75.11	56.51	57.19	57.13
40	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	58.96	58.47	69.01	68.47	58.85	76.65	91.16	59.07	58.27	58.77	75.42	69.50	74.17	73.71	58.87	75.50	58.52	68.37	75.84	74.58	58.24	59.34	75.72	57.88	69.17	56.98
23	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	58.34	58.75	58.66	58.34	59.27	74.05	76.66	57.89	74.93	58.17	74.68	75.15	89.19	74.33	57.37	73.39	74.89	74.53	74.69	74.50	57.50	57.19	75.61	57.34	75.92	68.37
51	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	58.99	68.98	58.66	59.39	58.56	76.94	75.03	57.27	58.25	57.99	75.11	75.11	72.17	74.31	58.09	73.99	57.47	74.41	75.57	74.74	57.41	58.40	73.87	57.03	56.58	75.81
32	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	69.85	58.79	58.48	58.77	58.35	67.44	74.21	58.89	59.05	57.97	75.16	75.41	67.60	58.49	57.58	74.39	75.05	73.69	75.96	68.50	91.87	58.00	74.64	59.22	74.84	57.39
4	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	58.72	58.40	68.62	58.59	58.45	75.12	75.03	58.46	57.03	89.57	70.42	75.22	89.51	74.11	58.10	73.49	58.39	74.31	75.57	76.42	75.28	58.26	75.89	56.97	76.19	68.44
74	372	8	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	73.64	57.53	58.46	58.61	58.76	69.29	74.04	58.14	58.24	58.05	74.61	58.84	68.37	74.09	59.75	74.65	58.71	69.43	76.25	74.92	57.24	58.06	75.96	58.07	57.19	76.02
70	372	8	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	69.27	59.01	58.37	60.70	58.50	75.97	75.10	56.98	57.88	58.05	75.84	68.78	74.77	74.07	58.80	73.87	73.19	74.07	75.58	70.03	58.25	56.69	75.77	58.23	57.29	56.91
64	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	58.71	58.30	58.09	57.59	57.71	75.66	74.34	58.09	68.36	58.65	74.91	75.07	68.03	58.23	58.24	73.38	58.75	73.80	75.19	74.91	56.41	57.95	76.51	57.82	70.23	58.34
37	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	59.06	58.98	58.25	57.92	58.80	75.78	86.72	57.08	74.33	58.18	74.87	67.77	74.89	69.09	58.96	69.00	73.83	73.85	70.73	75.36	57.50	59.13	74.68	60.06	75.43	57.64
29	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	69.36	58.34	57.22	57.59	58.94	75.80	74.09	57.26	91.27	58.09	75.63	57.97	67.55	91.12	58.37	90.14	57.35	71.85	75.47	75.31	47.36	57.57	75.29	56.75	68.98	57.75
5	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	58.99	58.74	75.06	57.80	58.51	74.45	73.12	90.53	58.18	57.71	76.06	76.13	67.43	75.55	58.56	74.33	69.50	74.28	74.71	75.17	75.02	58.36	75.42	56.92	69.42	75.76
20	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	58.62	59.55	59.43	59.42	59.38	74.78	88.80	67.89	68.83	58.61	75.19	74.82	73.90	73.75	58.71	73.81	57.80	68.64	74.15	75.42	74.47	58.25	75.92	57.64	59.19	75.97
31	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	58.74	58.56	68.55	58.06	58.70	75.73	74.24	58.51	56.90	58.08	75.36	75.42	75.44	75.10	57.84	89.89	74.56	73.40	69.32	74.53	57.75	57.50	75.27	56.83	75.75	57.29
39	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	58.71	58.58	58.45	57.63	58.51	91.40	74.09	58.49	69.13	68.58	69.80	76.53	74.93	74.84	57.40	69.09	58.21	74.28	75.63	73.23	57.64	57.41	76.97	58.26	74.96	57.87
25	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	74.88	58.19	74.82	57.96	59.25	91.70	73.19	57.60	57.64	68.18	75.13	75.43	73.97	75.44	58.74	73.41	56.85	73.15	75.13	75.30	56.56	57.13	75.82	76.14	56.83	57.47
26	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	58.68	59.12	59.82	58.82	59.07	76.34	74.53	91.43	68.52	68.34	75.62	75.09	88.54	73.74	59.08	58.89	59.04	59.23	75.40	74.58	58.22	57.59	75.41	66.74	57.51	57.90
28	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	90.46	58.81	59.19	59.11	59.16	75.41	73.88	58.43	88.79	58.51	75.46	58.86	74.32	58.27	59.00	74.15	58.55	73.63	74.74	75.05	57.50	58.00	75.33	57.78	75.38	68.10
52	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	59.25	58.45	59.19	57.95	58.23	75.18	74.23	57.51	57.70	58.09	74.69	70.32	74.43	74.88	57.74	74.24	69.77	74.64	74.92	75.37	57.80	57.75	76.24	75.39	57.74	57.32
91	372	8	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	58.65	58.91	58.70	58.70	61.91	57.62	75.95	57.97	58.02	57.61	76.34	57.81	89.05	58.71	58.19	67.97	57.18	68.61	75.11	75.62	57.12	59.14	75.66	57.70	57.01	58.53
60	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	74.19	58.31	58.76	56.99	59.50	76.67	74.30	58.73	59.12	58.15	74.87	75.89	68.37	74.29	60.18	73.26	58.29	89.91	75.89	75.08	57.50	56.03	57.30	57.11	57.48	57.71
47	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	74.24	59.81	59.21	58.32	61.54	57.26	68.62	59.23	69.27	57.98	75.63	69.57	73.80	73.02	60.03	67.25	69.76	74.16	75.22	75.16	57.97	57.97	75.60	58.54	57.89	76.11
15	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	70.87	58.63	91.63	59.26	58.94	75.27	73.61	58.52	60.50	60.45	76.52	75.17	73.96	69.71	59.31	72.68	58.06	73.74	75.42	74.43	58.43	57.25	90.34	59.43	69.45	59.08
76	372	8	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	59.22	58.50	58.45	58.42	59.01	56.90	73.53	58.53	58.52	58.57	75.16	74.34	73.04	69.68	58.43	72.72	59.22	74.31	75.95	75.10	57.45	58.91	68.52	58.85	75.69	57.11
89	372	8	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	58.81	58.20	58.17	58.97	59.10	76.65	74.14	57.79	58.54	57.80	74.66	74.64	75.00	57.54	58.51	75.09	58.06	68.77	75.35	69.54	45.32	57.93	76.14	57.23	75.47	69.01
36	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	58.79	58.54	68.82	60.03	60.49	74.60	68.59	58.84	58.24	58.62	75.61	75.44	89.48	59.07	58.50	73.53	59.14	68.91	74.69	75.42	91.11	59.30	76.29	58.08	58.48	58.99
33	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	58.74	57.18	57.98	58.50	58.53	75.86	74.31	87.09	57.63	57.79	75.31	75.13	89.14	74.58	58.83	71.36	59.09	71.96	75.20	74.43	56.98	57.84	75.18	57.72	57.16	58.06
57	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	59.74	57.96	92.21	58.44	58.79	75.05	68.83	56.83	58.35	58.41	76.15	56.78	67.53	74.23	57.44	67.70	69.76	89.08	75.15	75.11	46.88	57.82	70.14	57.29	56.98	57.32
55	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	58.71	57.68	58.63	58.66	59.44	57.98	73.45	58.09	59.70	90.41	75.30	75.42	68.69	69.00	58.02	68.07	59.13	73.86	76.36	75.65	57.07	57.75	75.16	57.87	58.13	68.57
22	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	74.23	87.93	58.70	58.54	58.94	57.92	74.10	89.63	58.52	57.40	69.93	74.69	75.16	74.95	57.74	72.79	68.83	73.42	74.81	75.39	57.87	61.34	76.18	58.29	57.80	59.91
67	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	58.76	59.93	60.39	58.73	59.06	73.99	68.26	58.44	69.55	58.83	75.47	59.00	67.99	69.47	58.04	75.34	58.89	72.77	76.30	91.06	58.13	56.70	75.29	57.97	58.69	58.06
78	372	8	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	58.47	57.77	58.83	59.01	58.76	75.46	70.05	58.54	69.24	58.16	76.38	57.72	75.15	69.36	58.67	74.37	58.04	74.41	75.65	75.21	58.16	58.67	76.52	56.76	74.93	57.88
66	372	8	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	58.79	58.49	59.13	59.80	59.81	59.02	74.39	59.05	57.84	70.13	75.37	57.69	74.37	73.38	59.31	72.60	74.58	68.21	74.63	75.38	57.19	58.06	75.36	58.53	74.92	58.56
86	372	8	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	59.06	58.61	58.74	59.03	60.13	58.06	74.50	56.42	58.22	68.77	75.95	75.29	74.04	75.93	58.26	68.28	59.06	74.77	75.92	75.62	44.63	57.48	69.25	57.79	75.00	59.50
92	372	8	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	58.36	58.96	59.78	59.07	59.06	75.13	74.26	59.56	59.84	59.37	75.55	58.54	67.33	57.81	59.80	67.75	58.47	74.24	74.91	75.06	58.22	59.33	74.74	57.43	58.05	58.36
72	372	8	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	58.71	60.30	58.56	59.76	59.64	76.03	74.14	58.90	59.18	58.78	75.61	70.09	74.61	74.93	59.24	68.49	58.44	72.94	75.20	75.37	58.54	59.88	75.76	58.14	60.86	58.21
98	372	8	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	60.57	58.64	59.44	57.91	59.15	57.70	74.44	57.47	74.48	58.66	57.26	56.78	75.30	57.93	58.28	75.54	56.67	67.21	76.95	56.89	75.21	58.35	57.97	57.97	57.19	57.71
99	372	8	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	73.84	49.17	58.72	59.73	58.91	86.29	74.37	74.31	59.53	57.97	75.85	57.09	75.80	56.80	57.80	53.88	57.10	51.43	57.02	55.99	69.53	58.17	58.31	57.07	57.09	57.45
63	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	71.81	59.25	63.19	58.23	59.25	57.14	83.18	57.52	51.91	86.58	87.50	89.32	75.80	57.16	57.55	75.72	49.66	57.31	88.68	56.48	57.44	58.41	56.88	56.40	57.32	57.18
75	372	8	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	74.14	58.69	85.84	58.18	59.34	76.45	75.04	57.49	75.64	58.80	57.29	57.36	75.72	87.68	57.49	76.54	57.68	57.11	56.76	56.60	57.40	57.85	56.70	56.83	57.33	57.68
81	372	8	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	86.47	57.32	59.01	59.26	59.09	76.25	75.06	57.05	76.05	58.40	76.07	57.26	75.04	58.03	58.55	76.01	57.67	58.25	77.03	57.04	58.38	58.35	56.93	57.53	57.98	56.91
87	372	8	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	74.53	57.94	58.28	58.20	75.22	57.52	75.28	56.99	83.24	49.15	56.85	76.90	76.11	57.27	57.90	76.38	57.26	56.65	77.65	76.36	57.27	57.00	56.62	56.70	56.88	81.16
90	372	8	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	74.16	58.76	50.98	58.63	73.64	50.00	86.20	58.87	62.98	80.39	57.46	57.88	66.15	61.09	58.00	76.20	85.88	75.45	58.03	56.60	58.53	57.12	57.75	57.62	56.93	58.11
85	372	8	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	69.17	58.51	74.28	58.35	58.96	57.19	83.15	58.00	81.69	59.38	57.29	57.68	75.97	57.39	57.58	57.40	56.89	75.35	87.02	85.45	56.78	56.89	56.72	56.18	56.76	56.86
88	372	8	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	74.51	58.92	74.78	57.90	58.13	76.06	90.46	57.77	56.43	57.98	76.75	56.64	75.88	57.21	57.70	83.58	83.92	57.14	56.63	56.36	57.52	56.72	56.39	56.43	57.78	56.58
96	372	8	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	80.34	59.29	59.05	58.93	59.59	56.90	74.95	58.10	84.47	59.67	57.32	85.82	76.02	57.74	57.80	76.40	57.41	75.53	50.25	56.47	59.33	58.65	51.67	57.38	57.72	57.47
77	372	8	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	73.78	58.15	74.72	58.27	58.83	76.15	85.60	57.96	75.71	56.58	87.09	56.61	62.42	62.59	57.49	76.31	56.89	63.29	77.38	56.58	56.23	56.86	56.97	56.43	56.45	56.93
56	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	58.22	57.50	58.12	58.46	58.59	76.37	58.98	58.78	57.82	87.52	67.37	57.26	83.45	57.48	58.12	82.84	57.66	80.70	76.33	88.83	67.35	57.13	56.37	56.85	57.85	57.28
93	372	8	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	74.66	49.17	58.87	63.78	65.69	76.58	75.02	57.24	75.55	86.19	90.08	56.41	76.71	56.50	58.79	57.11	57.06	57.93	57.54	56.21	58.24	58.07	56.70	57.18	57.47	57.22
94	372	8	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	52.21	57.48	64.27	58.17	58.12	57.99	73.27	57.83	58.25	58.93	57.40	57.53	75.69	76.71	57.59	89.51	85.40	75.99	76.35	49.50	57.17	58.05	58.39	57.36	57.65	57.14
83	372	8	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	73.99	58.26	58.24	58.66	59.29	75.77	73.20	57.42	57.61	74.62	58.13	56.66	75.84	57.39	57.61	76.21	57.28	75.61	76.59	87.01	57.69	57.67	57.22	56.83	57.60	56.83
95	372	8	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	60.53	58.35	59.34	58.34	65.12	76.21	58.53	57.83	59.34	51.32	76.53	65.28	75.19	56.67	58.08	89.32	57.71	59.01	76.60	56.64	57.59	58.16	57.37	57.36	57.26	57.49
38	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	74.86	58.38	58.51	58.35	60.32	57.58	74.77	65.30	86.29	57.82	57.58	56.79	75.15	84.31	57.43	88.58	66.37	75.57	76.51	90.76	56.47	56.13	56.57	56.81	55.77	57.47
68	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	73.96	59.25	85.90	58.23	59.02	76.79	74.72	57.48	86.52	53.53	57.61	57.37	56.31	57.30	57.43	77.16	57.05	75.73	90.20	88.62	55.86	57.45	56.68	56.35	56.38	56.92
71	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	74.92	58.90	52.31	58.14	59.44	56.52	74.92	56.86	83.52	57.10	76.33	57.26	76.48	56.08	57.17	87.62	57.51	64.14	76.60	88.25	57.47	56.68	55.82	55.82	56.78	56.93
69	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	55.02	58.19	64.99	58.76	50.63	50.42	87.66	57.54	64.27	58.82	89.28	56.88	75.24	89.48	58.00	86.01	57.07	63.92	90.98	56.76	57.78	56.50	57.30	57.26	56.63	57.18
41	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	54.09	58.26	74.93	57.56	75.44	76.39	75.61	57.36	75.87	58.99	77.70	76.90	76.17	57.64	58.00	87.76	56.59	90.85	56.76	56.56	71.18	56.60	75.74	56.26	56.45	56.30
43	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	59.50	58.60	81.92	58.26	58.33	76.09	86.18	57.66	81.27	58.02	76.14	57.50	76.52	57.84	57.56	76.71	58.35	75.57	75.92	56.53	57.95	57.24	57.01	57.74	87.20	56.68
44	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	59.82	58.51	75.03	58.45	74.41	57.71	74.15	58.10	87.40	57.39	91.32	57.31	75.82	82.72	57.73	68.77	56.98	84.57	76.84	56.44	57.04	57.08	57.44	56.51	57.63	56.93
46	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	73.98	58.79	65.05	59.11	74.40	50.26	76.00	64.33	58.61	59.09	76.16	90.39	86.00	58.01	57.96	82.49	56.98	86.52	56.71	56.76	57.89	71.72	57.07	57.43	57.84	57.00
61	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	74.01	58.54	50.55	69.49	59.12	50.44	75.19	57.80	74.80	58.51	50.25	57.75	75.16	87.81	57.64	75.39	87.55	87.07	76.32	56.38	56.76	56.98	56.92	56.93	56.62	70.58
84	372	8	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	74.61	58.88	50.49	58.30	74.12	76.17	75.90	57.47	56.71	58.54	75.79	56.63	89.34	75.76	58.67	73.85	57.24	50.15	88.02	56.58	79.85	56.63	56.28	57.58	56.96	56.87
79	372	8	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	74.50	58.26	74.06	58.76	59.11	57.52	88.66	58.42	66.90	58.68	76.20	56.73	75.83	86.61	58.44	75.74	58.39	59.51	57.20	56.88	56.44	57.87	57.59	56.76	58.00	58.13
73	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	73.96	59.04	74.98	59.39	65.85	49.17	82.61	57.87	83.10	58.55	90.88	57.44	57.13	57.84	58.37	76.14	75.66	74.38	77.05	57.50	57.12	57.93	57.93	56.91	67.03	60.49
54	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	74.86	57.77	58.57	58.16	59.39	57.23	74.83	62.22	88.99	62.71	75.67	56.75	75.38	57.38	59.44	86.77	56.92	62.66	56.50	90.31	57.48	56.54	75.39	56.19	57.73	56.37
45	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	74.76	57.71	57.82	60.73	58.48	76.63	73.21	56.75	51.41	88.69	76.96	56.95	76.59	89.25	56.28	77.09	57.01	89.39	75.92	55.99	56.81	57.55	56.45	56.44	56.76	56.31
82	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	74.48	58.38	75.26	59.12	74.51	76.15	87.18	57.66	89.33	50.27	57.20	56.88	87.78	58.25	57.70	88.17	58.24	62.23	57.03	56.40	56.19	70.14	56.31	49.17	57.31	56.93
59	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	84.75	60.23	73.98	59.25	59.58	76.24	49.17	58.77	59.34	59.28	76.26	57.50	75.34	58.27	75.15	88.18	57.69	91.72	76.00	57.29	58.15	58.11	57.28	57.39	57.76	58.50
97	372	8	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	74.45	75.22	57.91	69.97	56.79	76.17	51.08	57.40	88.87	49.17	76.30	57.36	76.05	57.53	57.23	88.99	57.61	56.66	76.60	57.31	56.65	57.43	56.99	56.19	56.77	56.27

Size of the test data:  (100, 34)

Difference

diff_mw = dt_mw[['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']]
for i, cols in enumerate(zip(dt_mw.columns,test_data_mw1.columns)):   
   diff_mw[f'col_diff_{i}'] = (np.array(dt_mw[cols[0]]) - np.array(test_data_mw1[cols[1]]))*-1

# Function to count negatives in a row
def count_negatives(row):
    return sum(1 for value in row if isinstance(value, (int, float)) and value < 0)

diff_mw['negative_count'] = diff_mw.apply(count_negatives, axis=1)

diff_mw.sort_values(by =["negative_count"],inplace = True, ascending=False)


html_table = diff_mw.to_html(index=True)

# Wrap in a scrollable div
scrollable_table = f"""
<div style="height: 400px; width: 100%; overflow-x: auto; overflow-y: auto;">
    {html_table}
</div>
"""
# Display the scrollable table
display(HTML(scrollable_table))

key_values = ['input_size', 'output_size', 'learning_rate', 'batch_size', 'alpha', 'margin', 'l1_reg', 'l2_reg']
print('Are the keys of the valid and test dfs same?: ',dt_mw[key_values].equals(test_data_mw1[key_values]))

	input_size	output_size	learning_rate	batch_size	alpha	margin	l1_reg	l2_reg	col_diff_0	col_diff_1	col_diff_2	col_diff_3	col_diff_4	col_diff_5	col_diff_6	col_diff_7	col_diff_8	col_diff_9	col_diff_10	col_diff_11	col_diff_12	col_diff_13	col_diff_14	col_diff_15	col_diff_16	col_diff_17	col_diff_18	col_diff_19	col_diff_20	col_diff_21	col_diff_22	col_diff_23	col_diff_24	col_diff_25	col_diff_26	col_diff_27	col_diff_28	col_diff_29	col_diff_30	col_diff_31	col_diff_32	col_diff_33	negative_count
143	372	8	0.10	32	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-3.72	-6.82	-5.89	-6.90	-4.24	0.93	-7.31	-6.75	-6.28	-5.55	1.72	-5.53	0.57	-6.89	-6.44	4.48	-7.31	-6.29	0.96	-7.45	-8.36	-7.27	-7.57	-8.26	-6.99	-7.60	21
583	372	8	0.01	48	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.44	-5.64	-6.33	-5.65	-3.97	-6.59	0.42	-5.94	-6.75	-7.82	1.16	-5.51	0.16	-5.16	-5.20	-2.95	-5.82	-2.30	0.59	1.04	-6.59	-5.05	3.03	-6.77	-6.46	-5.87	20
282	372	8	0.10	48	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-3.33	-7.97	-4.64	-5.81	-5.19	-6.47	3.76	-7.51	-3.08	-5.61	2.76	-7.07	1.63	3.76	-5.66	4.29	-6.82	-5.05	5.67	-7.55	-7.89	-8.13	-7.66	-7.56	-7.79	-7.56	20
643	372	8	0.01	48	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.52	-6.13	-6.31	-6.48	-6.19	-6.48	-0.23	-6.29	-6.25	-6.60	1.29	0.16	-0.05	-1.03	-4.81	-0.53	-6.04	0.57	2.10	1.27	-6.98	-5.50	-1.03	-5.49	1.80	-8.03	20
601	372	8	0.01	24	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.83	-5.96	-5.32	-6.47	-5.34	0.73	1.28	-5.95	-1.50	-6.75	1.29	1.33	-0.36	-4.29	-4.81	-0.94	0.16	-2.06	-1.69	-2.73	-6.19	-7.13	-0.83	-7.42	1.72	-7.55	20
541	372	8	0.01	24	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-3.06	-6.25	-5.78	-6.40	-5.35	0.39	0.24	-6.67	-1.97	-1.64	1.78	0.98	-3.27	-2.03	-4.74	-2.97	-1.05	-2.70	0.90	-2.26	-6.39	-6.43	2.94	-6.88	-6.01	-1.49	20
462	372	8	0.01	48	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.43	-5.55	-4.40	-6.08	-5.73	-0.71	-2.74	-5.13	-0.10	-7.26	0.87	-5.24	-3.90	-2.28	-4.64	2.03	-4.02	0.25	1.88	3.03	-6.13	-7.09	2.37	-7.19	-5.00	-5.88	20
123	372	8	0.10	24	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.23	6.51	-6.25	-6.60	-5.95	6.25	2.08	-1.10	-4.20	-7.74	1.24	-6.76	0.83	-6.98	-6.49	-6.94	-7.72	-5.50	-6.88	-8.93	-2.83	-8.22	-6.76	-7.52	-8.31	-7.62	20
241	372	8	0.10	24	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-4.95	-6.67	-6.03	-6.77	-5.81	-7.82	1.79	-7.38	3.03	-6.16	-6.68	-6.77	1.32	-6.08	-6.24	1.64	-8.18	-4.46	1.97	-7.07	1.12	-7.49	-7.51	-6.06	-7.76	-7.21	20
20	372	8	0.10	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.38	-5.88	-5.63	-6.38	-5.36	-5.98	1.63	-7.93	5.04	-6.16	-6.51	3.91	1.32	-6.56	-7.10	2.60	-7.19	1.72	-5.76	-8.17	-7.67	-6.72	-4.19	-8.21	-7.61	-9.01	19
522	372	8	0.01	48	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.26	-5.82	-5.47	-5.88	-5.39	0.76	0.37	-5.45	-4.75	-5.71	1.46	-4.95	-3.90	-6.30	-3.96	-2.67	-5.83	0.94	1.34	0.26	-6.20	-5.63	2.56	-7.19	-6.93	-7.14	19
523	372	8	0.01	48	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.88	-4.01	-6.35	-5.79	-5.56	1.41	-0.51	-4.90	-5.17	-5.97	1.03	-0.37	1.47	1.87	-4.87	-1.04	-5.35	-0.12	0.84	0.05	-6.59	-5.20	3.35	-7.29	-3.99	-6.44	19
83	372	8	0.10	32	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-4.98	-8.11	-5.58	-6.81	-6.82	-6.32	1.04	-5.95	-6.90	-5.65	-6.15	-7.04	1.04	2.24	-5.24	5.89	3.48	1.08	1.22	-6.49	-7.18	-8.00	-7.79	-7.94	-7.63	-7.96	19
460	372	8	0.01	48	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.47	-6.44	-6.00	-6.82	-6.07	-5.19	-1.15	-6.22	-6.17	4.05	0.97	0.90	-0.83	-1.74	-5.46	-2.94	-5.45	0.73	1.02	1.62	-6.10	-6.44	2.53	-6.86	-5.40	-0.99	19
382	372	8	0.01	32	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.39	-6.67	-5.64	-5.83	-5.75	-1.75	-0.21	-5.46	-5.41	-7.35	0.24	-5.70	-3.01	0.50	-3.98	1.15	-4.93	-1.71	1.49	0.90	-6.18	-5.54	3.31	-5.34	-6.95	2.39	19
440	372	8	0.01	32	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.37	-6.64	-6.21	-6.40	-6.56	0.56	-0.33	-5.87	-1.72	-5.97	0.30	0.30	-2.51	-5.36	-5.22	-0.74	-5.47	0.76	0.80	0.08	-7.19	-6.31	2.60	-6.88	-1.85	-6.17	19
23	372	8	0.10	32	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-1.74	-6.56	-6.74	-6.94	-6.47	2.17	-6.09	-6.01	-6.32	6.54	-4.58	-6.32	2.45	-7.15	-5.19	4.15	-6.42	2.05	1.85	4.03	-2.54	-7.66	-7.48	-8.12	-7.89	-7.39	19
263	372	8	0.10	32	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.67	-7.05	-4.97	-6.43	0.43	-6.78	3.59	-5.99	-1.38	3.50	-6.74	-5.70	-3.78	-6.36	-5.99	1.13	3.28	0.39	-5.77	-7.06	-5.56	-7.84	-8.22	-7.17	-8.30	-9.93	19
41	372	8	0.10	48	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.89	-6.54	0.48	-6.55	-5.88	-6.28	5.33	-6.76	-6.13	-7.33	1.61	-6.46	2.19	4.03	-6.53	1.28	-7.58	-2.69	-6.67	-6.35	-6.98	-7.68	-7.31	-8.42	-7.20	-6.28	19
342	372	8	0.10	48	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.67	-7.04	-0.82	-5.97	-0.18	-6.10	1.68	-4.38	-6.29	-6.19	1.11	3.31	4.10	-5.70	-6.43	3.90	-5.85	3.98	-6.40	-7.06	-6.37	-1.84	-7.49	-7.55	-6.41	-8.36	19
341	372	8	0.10	48	0.00001	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.57	-6.06	1.30	-6.38	-0.19	-5.15	-0.51	-5.14	1.15	-6.20	4.64	-6.01	0.97	2.23	-5.13	-1.70	-6.83	3.93	1.95	-7.20	-6.62	-7.66	-6.65	-7.56	-6.83	-7.33	19
281	372	8	0.10	48	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.31	-5.77	-5.61	-6.21	-5.12	-8.27	-0.25	-6.90	4.20	-6.91	1.48	-6.31	0.75	-7.10	-8.10	3.12	-5.95	-6.10	1.46	2.72	-6.86	-8.07	-8.00	-7.19	-7.73	-7.35	19
81	372	8	0.10	32	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.17	6.51	-5.83	-3.66	-5.20	1.22	1.48	-7.54	1.57	3.73	4.11	-7.43	1.65	-6.51	-7.43	-7.17	-7.72	-7.05	-6.41	-7.30	-7.33	-8.13	-8.16	-8.15	-7.39	-7.88	18
622	372	8	0.01	32	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.98	-6.18	-1.31	-5.93	-6.79	0.21	0.57	-6.00	-2.23	-1.28	-2.71	1.75	1.28	-2.49	-5.98	-0.95	-5.23	-0.79	0.59	0.44	-6.46	-6.66	2.02	-6.62	3.09	-7.16	18
641	372	8	0.01	48	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.14	-5.59	-5.77	-6.31	-4.19	-5.71	-2.49	-5.12	-1.06	-7.52	0.80	-1.97	0.20	-0.06	-3.41	-4.29	-1.00	1.35	0.88	0.64	-5.95	-6.20	2.44	-5.95	-6.58	2.31	18
400	372	8	0.01	48	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.39	-6.56	-5.75	-5.77	-5.86	1.76	-0.17	-6.15	-5.68	-6.53	0.54	0.19	1.61	-4.27	-5.66	2.24	-4.83	-1.25	0.55	-1.04	-7.94	-5.97	4.23	-6.44	2.36	-0.71	18
441	372	8	0.01	32	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.71	-5.41	-5.74	-6.96	-5.65	1.34	0.68	-5.67	-0.34	-6.86	1.27	-3.73	0.79	-2.55	-4.41	-1.55	-0.64	0.97	-1.48	0.83	-6.44	-6.81	2.00	-5.16	2.54	-7.08	18
43	372	8	0.10	48	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.44	-6.91	-6.00	-6.31	-5.31	-5.41	1.90	-7.34	4.59	-6.07	0.73	-6.71	0.46	-5.83	-5.30	4.08	-6.85	-3.04	-7.45	3.75	-7.11	-6.78	2.49	-8.09	-6.39	-8.72	18
403	372	8	0.01	48	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.63	-6.55	5.28	-6.31	-5.72	0.42	-1.77	-6.74	-5.73	-6.55	1.79	-6.79	-2.50	1.23	-6.00	-2.94	-0.86	2.66	1.07	0.86	-7.79	-7.18	0.64	-6.77	-7.95	-6.57	18
343	372	8	0.10	48	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.10	-5.97	-6.32	-3.34	-7.35	-5.79	0.52	-6.71	-0.42	-6.06	-5.53	-6.32	0.23	2.72	-6.36	0.18	3.38	5.76	1.20	-7.16	-6.64	-7.48	-7.53	-7.58	-7.76	-1.23	18
640	372	8	0.01	48	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.38	-6.07	-5.00	-7.43	-5.24	1.89	0.50	-5.25	-6.27	-6.47	0.79	1.85	-2.06	0.45	-4.45	-0.54	-4.53	3.25	1.31	-0.17	-5.69	-7.27	-6.39	-6.45	-7.19	-5.98	18
322	372	8	0.10	32	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-2.18	-6.77	0.74	-6.51	-6.68	-5.93	4.46	-6.37	5.38	0.08	-7.00	-6.06	1.01	-6.70	-5.08	-7.41	-7.45	0.36	4.97	4.10	-7.76	-7.76	-7.79	-7.71	-7.65	-7.52	18
22	372	8	0.10	32	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.65	-6.74	2.44	-6.59	-5.85	1.21	4.74	-6.85	1.18	-7.27	2.56	-6.48	-5.80	-5.88	-6.71	2.03	-5.82	-4.42	2.38	-5.97	-7.24	-7.73	-7.66	-7.14	-7.75	-7.44	18
202	372	8	0.10	32	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.63	-6.75	6.71	-7.17	-5.97	1.95	1.14	-8.57	1.64	-6.15	-7.00	-7.18	0.79	3.64	-5.49	1.50	-6.70	-6.52	-7.79	-6.48	-7.89	-7.06	-7.60	-8.92	-7.51	-8.16	18
203	372	8	0.10	32	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	5.39	-8.89	-6.58	-5.35	-6.53	0.59	2.03	-7.66	1.89	-7.49	1.19	-6.43	0.06	-5.72	-5.26	1.04	-5.82	-6.08	2.10	-6.65	-8.18	-6.19	-6.56	-7.78	-6.94	-8.24	18
362	372	8	0.01	24	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	3.44	-5.76	-5.82	-6.72	-6.51	-0.02	-1.51	0.59	1.04	-7.13	-3.89	-0.15	0.58	0.78	-5.55	-0.14	0.56	-1.62	1.61	-1.00	-6.47	-6.83	2.00	-7.03	-6.01	-7.22	18
201	372	8	0.10	32	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	2.29	-7.11	-3.27	-6.65	-5.97	-5.48	3.60	-8.03	-4.34	5.98	2.62	4.98	1.33	-6.12	-6.24	1.20	-6.07	-7.70	3.24	-7.87	-6.91	-8.18	-7.23	-9.04	-7.09	-8.44	18
323	372	8	0.10	32	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.30	-6.58	1.61	-7.08	-6.52	0.74	10.17	-7.43	-4.21	-6.64	1.83	-6.93	1.00	-6.73	-5.98	3.01	4.60	-6.91	-6.56	-6.67	-6.98	-7.01	-7.60	-7.77	-6.84	-7.39	18
401	372	8	0.01	48	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.70	-6.19	-1.05	-5.48	-4.76	0.73	-1.99	-5.84	-6.83	-6.90	1.11	0.92	2.33	-4.84	-5.25	0.12	-6.06	-0.81	1.09	0.58	3.79	-5.14	3.90	-6.70	-5.71	-5.43	17
642	372	8	0.01	48	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.33	-5.73	4.80	-5.48	-6.07	0.19	-0.70	-4.93	-4.76	-4.91	1.70	0.37	0.07	-0.36	-4.37	-1.53	-6.27	0.62	1.31	-0.69	-5.87	-6.94	5.04	-5.15	-0.79	-6.17	17
103	372	8	0.10	48	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.08	-6.30	1.06	-6.02	-0.00	0.95	4.50	-6.36	4.43	-5.57	-6.19	-6.33	4.00	-5.82	-6.55	4.39	-5.55	-5.91	-6.58	-6.81	-7.02	-2.50	-7.88	6.51	-7.33	-7.81	17
223	372	8	0.10	48	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.15	-6.05	4.18	-6.73	-5.22	1.78	0.67	-6.94	2.46	-1.83	-5.58	-5.34	-2.79	-6.95	-6.34	1.25	-6.26	1.71	5.79	4.49	-7.33	-7.42	-7.08	-7.39	-8.37	-6.84	17
402	372	8	0.01	48	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.99	-7.54	-6.22	-6.86	-6.25	1.33	0.22	0.38	-6.67	-5.87	1.28	-0.11	1.23	1.69	-5.44	-2.08	-4.98	-0.85	1.56	0.15	-6.71	-4.70	3.00	-5.70	-6.87	-6.39	17
221	372	8	0.10	48	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.89	-5.85	-6.58	-6.46	-5.83	-5.31	0.12	-7.24	3.57	-6.50	-4.83	-5.78	1.48	3.28	-6.36	2.89	-3.68	1.91	1.62	4.43	-7.38	-7.88	-7.79	-7.32	-8.38	-6.90	17
40	372	8	0.10	48	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.70	-5.67	-5.26	-6.26	-0.65	1.01	2.76	-6.83	-7.29	-6.02	0.93	-6.12	3.86	1.36	-4.62	2.68	-5.88	-5.49	4.28	-6.48	6.28	-7.23	-7.15	-7.21	-7.33	-7.89	17
520	372	8	0.01	48	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.52	-6.11	-5.65	-5.63	-5.69	-5.30	0.52	-5.10	-5.33	0.16	1.78	-6.16	0.45	0.05	-4.02	-1.17	1.43	-3.12	-0.97	1.07	-5.72	-5.50	2.20	-6.00	0.52	-6.92	17
142	372	8	0.10	32	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.38	-6.08	-6.49	-6.68	-5.74	1.44	2.81	-7.27	-7.08	0.73	-5.96	-6.93	1.85	-6.23	-6.85	1.71	-6.78	1.12	1.95	4.47	-5.59	-7.50	-7.52	-8.19	-6.96	-7.90	17
521	372	8	0.01	48	0.00100	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.70	-5.92	-5.75	-5.83	-4.78	-6.01	0.63	-7.36	-6.02	-1.98	1.36	0.93	0.86	2.37	-5.13	-2.50	-5.71	1.94	2.09	1.08	-7.91	-6.64	-0.08	-7.00	3.06	-5.30	17
163	372	8	0.10	48	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.28	1.80	-6.93	-2.34	-2.47	-0.00	-7.00	-8.76	4.98	6.51	0.91	-5.62	2.23	-7.29	-7.42	4.14	-5.17	-7.59	1.46	-6.24	-6.63	-6.13	-7.78	-8.58	-7.72	-8.32	17
421	372	8	0.01	24	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.90	-4.36	-3.81	-5.62	-4.82	0.37	0.93	-4.75	-3.53	-6.95	-1.79	1.78	0.71	0.55	-3.48	-3.21	-4.60	0.54	-0.01	0.77	-6.41	-6.54	-1.61	-6.79	-6.38	2.50	17
580	372	8	0.01	48	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.76	-6.06	-5.69	-6.24	-5.55	0.94	0.34	2.50	-1.69	-1.67	1.50	0.99	0.83	0.61	-4.52	-6.38	-4.59	-5.44	1.80	-0.20	-6.48	-6.40	2.77	-2.33	-6.71	-6.57	17
502	372	8	0.01	32	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.49	-6.17	-5.54	-7.05	-6.27	1.83	0.24	-5.88	-1.78	-1.23	-0.30	1.47	1.34	1.28	-6.07	-2.23	-6.12	1.45	1.95	-0.73	-5.64	-6.53	2.06	-6.29	2.26	-7.67	17
562	372	8	0.01	32	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.63	-5.55	-5.58	-6.62	-6.06	-0.36	0.20	-5.15	-6.34	-6.25	0.73	1.16	-3.46	-1.95	-5.28	1.81	-5.26	0.65	0.63	0.95	2.53	-6.87	1.76	-7.17	-7.15	-6.22	17
620	372	8	0.01	32	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.38	-6.40	-6.07	-6.48	-6.50	0.96	0.81	-6.19	-6.21	-6.22	1.28	1.48	-0.70	0.78	-5.76	-2.46	-5.45	2.24	1.12	1.61	-6.85	-7.02	2.56	-6.93	-6.82	-6.91	17
661	372	8	0.01	24	0.00001	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-1.25	-5.18	-5.46	-6.76	-6.08	0.62	0.72	-2.35	-1.36	-6.45	0.70	0.41	-1.84	1.28	-5.55	-2.92	-5.80	4.17	1.30	-1.45	1.63	-6.50	1.52	-6.58	-6.12	-7.56	17
480	372	8	0.01	24	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.68	-6.65	-5.19	-6.64	-4.86	-5.26	0.29	1.49	-6.88	-6.90	-2.96	0.86	0.25	0.43	-5.06	-3.43	-0.31	-2.83	-2.80	0.95	2.54	-5.18	2.03	-4.65	2.59	-5.41	17
361	372	8	0.01	24	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.87	-7.32	-5.67	-6.27	-6.62	-1.57	-0.85	-1.99	0.94	-6.59	1.18	1.35	-2.78	1.39	-5.49	-1.57	0.39	0.86	0.74	1.08	-6.30	-7.07	-0.76	-7.22	-1.96	-7.02	17
680	372	8	0.01	32	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.47	-5.80	0.09	-1.97	-5.93	0.60	1.75	-4.93	-6.09	-5.96	1.05	-1.95	-0.05	0.71	-5.00	0.31	-6.03	-2.56	1.61	0.59	-5.20	-5.11	2.81	-6.36	-1.28	-6.94	17
463	372	8	0.01	48	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-7.01	-6.63	-5.68	-5.78	-6.02	0.63	0.29	-4.20	-0.59	-6.25	1.99	-5.42	1.76	-1.08	-5.20	1.24	-5.58	1.62	1.54	0.64	-6.01	-5.07	2.63	-7.16	2.00	-7.01	16
481	372	8	0.01	24	0.00100	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.29	-5.54	1.49	-6.35	-6.66	-0.39	2.12	-6.64	-1.57	-6.96	2.23	1.23	1.21	0.10	-5.37	-4.00	0.91	-1.26	1.39	-0.05	-6.16	-6.55	3.50	-7.61	-6.80	-7.70	16
261	372	8	0.10	32	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.06	-6.83	-7.10	-6.15	1.19	-5.54	1.66	-7.20	2.97	-5.97	-6.46	2.29	1.22	-6.61	-5.08	1.87	-5.94	-6.73	2.52	1.82	-7.54	-6.95	-6.27	-6.33	-7.53	4.95	16
561	372	8	0.01	32	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.51	-5.57	-0.10	-6.22	-1.72	0.74	0.21	-5.09	-5.18	-6.59	0.97	-2.94	-1.56	-1.23	-4.54	-3.77	-1.66	0.71	0.47	1.41	-5.59	-7.09	2.20	-4.70	2.61	2.01	16
340	372	8	0.10	48	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.13	-6.01	3.59	-6.93	-7.60	0.71	3.30	-6.52	2.63	-6.97	1.00	-6.07	2.37	-6.50	-6.93	2.24	-5.19	1.46	0.79	-6.98	-5.84	-5.86	-7.16	-7.99	4.23	-7.36	16
621	372	8	0.01	32	0.00001	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.58	-6.25	-6.66	-5.68	-6.25	0.55	1.08	-4.51	-6.68	-5.44	1.53	0.37	0.61	0.43	-5.76	-3.48	-6.07	-2.71	-0.86	1.86	-5.75	-6.43	1.92	-6.75	3.33	-7.90	16
663	372	8	0.01	24	0.00001	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.23	-5.83	2.08	-6.85	-6.34	1.17	0.96	-5.66	-5.77	-5.85	2.01	0.28	-2.79	-5.09	-5.37	-2.51	0.55	1.03	-2.54	2.14	1.95	-2.21	2.79	-5.78	-7.30	-6.45	16
682	372	8	0.01	32	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.41	-1.78	-5.64	-5.62	-5.86	1.87	1.08	-7.14	-6.21	-5.96	0.74	1.07	-0.95	0.81	-5.75	0.60	-6.30	1.18	1.78	-0.03	-5.85	-5.13	1.07	-6.99	-6.86	2.40	16
42	372	8	0.10	48	0.00100	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.70	-6.19	1.86	-6.08	-5.28	6.51	3.41	-6.38	3.28	-6.11	4.43	-6.05	-2.84	-5.48	-8.14	1.23	1.29	0.31	1.35	-6.34	-6.77	-7.70	-6.19	-7.35	-2.22	-7.67	16
383	372	8	0.01	32	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.82	-5.13	-5.64	-5.30	-5.54	1.61	1.17	-6.45	-5.97	-6.73	1.45	-1.56	1.95	1.29	-4.59	0.58	-1.11	1.50	1.27	-0.79	-5.26	-7.24	3.35	-6.62	-6.75	-7.37	16
442	372	8	0.01	32	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.64	-5.63	-6.41	-6.98	-5.60	0.70	0.03	-6.72	4.24	-6.31	1.77	-6.11	-3.83	3.98	-5.14	2.77	-6.14	-1.26	0.88	1.31	-7.98	-7.17	2.90	-7.02	-2.24	-7.15	16
100	372	8	0.10	48	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.15	-7.08	-5.27	-8.21	-5.67	0.57	1.37	-6.97	-4.32	4.49	2.05	-6.38	1.94	3.00	-6.25	2.17	-6.34	3.22	0.54	-6.67	-7.99	-7.32	-7.81	-7.62	-6.49	-8.32	16
542	372	8	0.01	24	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.13	-6.78	-1.75	-6.71	-6.05	0.69	-1.06	2.20	-3.88	-6.17	1.16	1.34	-0.17	1.04	-5.41	-1.52	-0.40	-1.50	1.94	1.14	-5.49	-6.72	3.21	-7.12	2.29	-7.09	16
501	372	8	0.01	32	0.00100	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.75	-5.41	-1.01	-7.09	-5.83	1.36	-0.24	-5.56	-7.11	-5.64	1.22	1.53	1.59	1.78	-6.15	2.29	0.12	-0.21	-2.08	0.80	-6.07	-5.94	2.11	-6.38	1.87	-8.22	16
160	372	8	0.10	48	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.81	-6.52	0.79	-5.96	-5.68	1.34	6.51	-6.26	-5.60	-6.83	1.62	-6.57	0.63	-6.01	1.12	2.53	-6.06	5.37	1.06	-6.77	-6.16	-7.80	-8.43	-7.94	-7.64	-7.60	16
363	372	8	0.01	24	0.00100	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.37	-5.86	3.56	-6.20	-6.07	0.08	0.80	-5.50	-1.45	-1.92	2.02	1.73	-0.13	-1.57	-5.04	1.33	-5.20	-0.15	1.29	1.39	-7.57	-5.67	2.31	-1.50	3.50	-7.05	15
582	372	8	0.01	48	0.00001	24	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.99	-5.93	-5.10	-6.61	-5.98	0.77	0.76	-6.23	-7.15	-6.36	0.57	-0.75	1.03	1.86	-6.00	0.83	-1.51	1.80	1.13	1.58	-6.76	-6.17	3.84	1.48	-6.27	-7.31	15
660	372	8	0.01	24	0.00001	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.21	4.47	-5.45	-7.25	-5.53	1.01	0.90	-5.73	-2.64	-5.29	2.21	1.24	-3.04	-1.63	-5.24	0.76	0.69	-1.92	1.59	1.04	2.57	-2.40	-0.10	-7.21	-7.43	2.03	15
283	372	8	0.10	48	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.71	-6.86	1.05	-5.40	0.84	0.65	0.85	-6.81	1.48	-8.11	2.10	1.77	1.70	-4.92	-4.79	2.71	-6.48	3.38	-6.56	-6.99	-1.69	-7.19	4.43	-7.64	-6.74	-8.14	15
603	372	8	0.01	24	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.82	-5.78	-5.96	-6.59	-6.32	2.38	-2.26	-5.90	0.15	-7.47	1.81	-1.49	-0.87	0.23	-4.95	0.19	-5.44	0.78	2.57	1.72	-1.84	-7.00	1.97	-6.61	-5.85	2.23	15
543	372	8	0.01	24	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.73	-6.30	-1.79	-6.14	-5.69	-1.31	-0.14	-4.77	-5.88	-5.14	-1.50	2.07	1.55	0.78	-5.92	2.26	-0.63	1.10	0.38	0.36	-8.74	3.54	1.31	-7.09	1.23	2.41	15
420	372	8	0.01	24	0.00100	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.08	-5.89	-5.97	-6.15	-5.60	-0.33	1.29	-5.27	1.07	-1.49	0.80	0.12	0.36	-2.26	-5.17	1.88	-5.73	-1.60	0.94	1.37	1.54	-5.93	-1.06	-8.16	1.76	-7.47	15
483	372	8	0.01	24	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-0.17	-1.47	-5.19	-6.31	-5.82	-0.83	0.45	-5.54	-5.70	-6.47	0.80	1.30	1.83	-1.18	-5.54	0.58	-5.47	1.08	0.43	1.12	-6.76	-6.97	1.63	-5.51	2.20	1.87	15
422	372	8	0.01	24	0.00100	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.82	-2.07	-6.05	-5.99	-6.51	4.14	3.05	-5.70	3.05	-6.67	1.79	1.61	3.83	1.45	-4.43	-2.98	-6.36	1.30	0.96	0.25	-6.61	-7.07	2.15	-6.47	-3.64	-6.82	15
623	372	8	0.01	32	0.00001	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.23	-6.15	4.03	-6.73	-1.09	-0.63	-0.29	2.49	-5.60	-7.45	6.14	0.55	0.68	1.28	-5.64	1.19	-1.90	-0.66	1.24	1.85	0.20	-5.97	2.78	-6.98	-6.30	-6.93	15
500	372	8	0.01	32	0.00100	48	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.88	-6.45	-4.73	-5.43	-5.45	-0.37	2.30	-2.16	-1.80	-5.96	0.33	0.92	0.48	0.48	-4.50	0.10	-6.03	-2.56	0.03	1.15	0.92	-5.91	3.27	-7.59	-5.45	2.31	15
461	372	8	0.01	48	0.00100	36	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.28	1.32	-5.33	-5.98	-5.80	-5.85	0.23	2.59	-6.34	-6.33	-0.36	0.07	2.49	1.79	-5.64	-0.41	-1.30	0.10	0.68	1.29	-5.89	-3.02	3.03	-6.08	-6.94	-4.90	15
380	372	8	0.01	32	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.56	-6.46	-5.40	-6.15	-6.14	-3.86	1.00	-4.68	-6.62	-7.19	0.79	0.43	-3.95	-4.80	-5.61	0.55	0.45	0.82	0.95	-3.17	3.46	-6.19	1.73	-5.76	2.08	-8.33	15
540	372	8	0.01	24	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.74	-6.81	-6.19	-5.82	-6.34	0.74	1.31	-6.37	-6.26	-6.64	0.79	-2.27	-2.77	0.77	-5.00	0.04	-6.01	-2.13	2.33	0.18	-6.80	-6.52	2.90	-5.88	1.90	1.22	15
581	372	8	0.01	48	0.00001	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	4.82	-6.14	-5.07	-5.75	-5.78	0.50	-0.49	-5.54	1.31	-6.68	0.62	-5.13	1.20	-5.58	-4.50	0.28	-4.52	0.93	0.15	0.66	-6.42	-5.92	2.17	-7.20	1.95	-1.69	15
560	372	8	0.01	32	0.00001	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.84	-6.00	-5.46	0.55	-5.34	0.83	1.13	-5.00	2.53	-4.14	2.03	0.88	1.03	-5.16	-4.52	1.02	-5.69	0.69	0.99	0.86	-6.06	-7.01	0.80	-7.10	-7.11	-7.68	14
423	372	8	0.01	24	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.97	-5.58	-6.78	-5.50	-5.24	0.81	0.60	2.21	1.10	-6.29	2.26	1.68	-2.33	-2.78	-4.50	-0.80	0.78	-2.49	2.07	0.63	-7.10	-6.29	2.37	-5.87	3.03	-7.23	14
602	372	8	0.01	24	0.00001	36	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.85	-5.78	-1.06	-6.44	-6.18	0.30	0.39	-5.65	-6.01	-7.63	0.31	1.41	0.70	0.52	-5.66	1.91	2.17	-3.65	-1.49	0.90	-8.47	-6.95	2.10	-7.32	1.25	-7.21	14
360	372	8	0.01	24	0.00100	24	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.58	-6.42	-5.09	-6.04	-6.76	1.36	0.01	-2.30	-5.48	-6.19	1.85	1.75	1.04	0.99	-4.42	-2.32	-2.01	-0.39	0.71	0.31	-6.96	-7.01	2.16	1.84	2.42	-7.72	14
563	372	8	0.01	32	0.00001	24	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.07	-6.92	-6.58	-6.39	-5.50	0.68	0.26	-5.48	0.60	-5.90	1.25	0.35	-3.20	1.01	-5.69	-3.93	0.50	0.89	0.74	0.90	-5.63	-6.46	2.36	-6.12	-4.65	0.81	13
662	372	8	0.01	24	0.00001	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.62	-6.66	-0.51	-5.86	-5.01	0.99	0.72	-4.55	-4.27	-6.23	2.04	1.14	-2.35	0.86	-4.57	-0.25	-0.01	0.58	0.85	0.66	-6.19	-6.46	1.87	2.82	2.39	1.26	13
381	372	8	0.01	32	0.00100	24	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.78	-5.88	-1.34	-6.19	-6.08	0.33	0.18	-5.42	-6.44	1.73	-0.34	1.22	0.68	1.24	-4.55	0.89	-5.50	0.94	0.74	1.67	1.39	-6.51	2.34	-7.33	2.51	-1.68	13
443	372	8	0.01	32	0.00100	36	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-5.43	-6.18	0.49	-6.74	-6.00	-0.00	-0.42	2.02	-6.47	-5.91	1.81	1.62	-3.65	2.72	-4.97	0.87	-2.01	1.53	0.57	0.92	2.34	-6.03	2.06	-7.53	-2.71	2.41	13
503	372	8	0.01	32	0.00100	48	1.000000e-08	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.84	-6.60	0.86	-6.21	-5.23	2.68	-0.60	-5.86	-6.89	-2.73	0.80	0.98	0.05	2.22	-4.30	0.80	-5.67	1.03	1.04	1.02	-7.06	-6.38	3.61	2.28	-6.68	-6.79	13
681	372	8	0.01	32	0.00001	48	0.000000e+00	1.000000e-08	0	0	-0.0	0	-0.0	0	-0.0	-0.0	-6.26	-5.20	-5.18	-6.68	-5.13	-0.71	0.85	-6.24	1.21	-4.25	1.06	0.63	1.91	1.02	-5.52	0.18	0.73	0.62	0.83	0.54	-6.42	-6.50	3.08	-6.48	2.63	-1.97	13
600	372	8	0.01	24	0.00001	36	0.000000e+00	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	0.87	-5.24	-6.43	-5.47	-5.89	0.16	3.78	-5.72	-6.06	-5.82	0.57	1.96	0.24	0.80	-4.98	-1.11	0.76	0.88	0.54	0.97	-6.44	-6.62	2.43	2.49	2.61	-7.09	12
482	372	8	0.01	24	0.00100	48	1.000000e-08	0.000000e+00	0	0	-0.0	0	-0.0	0	-0.0	-0.0	1.08	-6.12	3.45	-6.84	-6.09	0.69	3.50	-6.58	1.59	-6.80	1.47	0.38	1.65	-5.55	-4.49	0.82	0.64	1.56	0.95	2.01	-6.63	-7.03	2.43	-7.45	-8.06	-8.12	12

Are the keys of the valid and test dfs same?:  False

Model performance on valid data

Average & Std Deviation of the Significant rows:

	mean	std
mAP_valid_abs_values_16	75.0092	5.651647
mAP_valid_abs_values_7	74.6767	5.816269
mAP_valid_abs_values_13	74.5702	5.280436
mAP_valid_abs_values_11	74.0128	5.755933
mAP_valid_abs_values_19	73.5403	4.463060
mAP_valid_abs_values_18	72.5249	5.521301
mAP_valid_abs_values_20	72.3495	6.257200
mAP_valid_abs_values_6	72.1377	7.017047
mAP_valid_abs_values_14	70.6853	6.147259
mAP_valid_abs_values_12	70.4902	5.614092
mAP_valid_abs_values_23	70.0235	4.421898
mAP_valid_abs_values_9	69.7733	7.060057
mAP_valid_abs_values	69.7361	5.403071
mAP_valid_abs_values_3	67.6477	6.583348
mAP_valid_abs_values_25	67.4887	5.143091
mAP_valid_abs_values_17	67.4234	5.467562
mAP_valid_abs_values_8	66.7780	6.634564
mAP_valid_abs_values_26	66.4829	3.491247
mAP_valid_abs_values_10	66.0376	5.919745
mAP_valid_abs_values_5	65.5601	2.961951
mAP_valid_abs_values_21	65.2480	5.350683
mAP_valid_abs_values_2	65.2101	5.127323
mAP_valid_abs_values_4	65.0940	1.529487
mAP_valid_abs_values_22	64.8179	2.795104
mAP_valid_abs_values_24	64.8165	3.173700
mAP_valid_abs_values_15	63.8231	1.259981

Model performance on Test data

We then apply the hyperparameters to the test set and average the results.

####################################################
# Use the hyperparameters to the test data.
####################################################
optimal_params = dt_valid.loc[dt_valid_sub_mw1.index].iloc[:, :6].reset_index()
optimal_params.drop(['index'], axis=1, inplace = True)

#rotation invariance test data with optimal parameters
test_data_1 = pd.merge(optimal_params, dt_test, how='left')
test_data_1_sub = test_data_1[list(test_data_1.columns[test_data_1.columns.str.startswith('mAP_test')])]
test_data_1['average_map'] = test_data_1_sub.apply(np.mean, axis=1)

test_data_1.sort_values(by=['average_map'], ascending= False,inplace=True)

	mean	std
mAP_test_abs_values_7	74.695650	7.585041
mAP_test_abs_values_13	74.567825	6.915213
mAP_test_abs_values_16	73.875575	8.196911
mAP_test_abs_values_11	73.791650	8.913692
mAP_test_abs_values_19	73.229775	7.847723
mAP_test_abs_values_18	71.753700	7.986762
mAP_test_abs_values_20	71.076725	9.661065
mAP_test_abs_values_6	70.748025	9.855997
mAP_test_abs_values_23	69.063025	8.908015
mAP_test_abs_values_14	68.447125	9.362696
mAP_test_abs_values_12	68.340925	9.273026
mAP_test_abs_values	67.069625	9.084060
mAP_test_abs_values_9	66.126575	10.050049
average_map	65.798158	2.276846
mAP_test_abs_values_3	63.808600	9.899891
mAP_test_abs_values_25	63.777450	9.055905
mAP_test_abs_values_17	63.297875	8.090686
mAP_test_abs_values_8	61.546900	9.078485
mAP_test_abs_values_26	60.932600	6.848936
mAP_test_abs_values_10	60.838150	7.608262
mAP_test_abs_values_5	60.145325	4.333112
mAP_test_abs_values_21	59.724575	8.138446
mAP_test_abs_values_2	59.645600	5.613230
mAP_test_abs_values_4	58.880650	2.513828
mAP_test_abs_values_24	58.729025	4.519123
mAP_test_abs_values_22	58.372625	4.027958
mAP_test_abs_values_15	58.266525	1.689238

Summary using radar plot

def extract_number(text):
    if isinstance(text, str):
        matches = re.findall(r'\d+', text)
        return int(matches[0]) if matches else 1
    return 1

res_valid1['id'] = res_valid1.index.to_series().apply(extract_number)
res_test1['id'] = res_test1.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid1,res_test1])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test1 = res_test1.sort_values(by=['id']).reset_index().query("index !='average_map'")
data_range1 = np.array(list(res_test1['mean']) + list(res_valid1['mean']))
categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test1['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid1['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "T-Test",
        'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range1.min()), round(data_range1.max()) + 1 + 1]
    )),
  showlegend=True
)

fig.show()

##############


res_valid2['id'] = res_valid2.index.to_series().apply(extract_number)
res_test2['id'] = res_test2.index.to_series().apply(extract_number)



res_comb = pd.concat([res_valid2,res_test2])
index_series = res_comb.index.to_series()

res_comb['type'] = np.where(
    index_series.str.contains('valid', case=False), 'valid',
    np.where(index_series.str.contains('test', case=False), 'test', 'unknown')
)
res_comb = res_comb.query("type !='unknown'")

res_comb =  res_comb.reset_index(drop=True)


res_test2 = res_test2.sort_values(by=['id']).reset_index().query("index !='average_map'")

data_range2 = np.array(list(res_test2['mean']) + list(res_valid2['mean']))

categories = [str(i) for i in range(1,26)]
fig = go.Figure()

# Valid
fig.add_trace(go.Scatterpolar(
       r=list(res_test2['mean']),
      theta=categories,
      #fill='toself',
      name='Test'
))

# Test
fig.add_trace(go.Scatterpolar(
      r=list(res_valid2['mean']),
      theta=categories,
      #fill='toself',
      name='Valid'
))

# Customization of chart
fig.update_layout(
  title={
      'text': "MU-Test",
         'xanchor': 'center',
      'yanchor': 'top'
  },
  polar=dict(
    radialaxis=dict(
      visible=True,
      range=[round(data_range2.min()), round(data_range2.max()) + 1]
    )),
  showlegend=True
)

fig.show()

Comparisons of bit size results

T-test curves

MU-test curves